You should train both a feedforward network and a CNN on image classification on imagenet, to see if we see that the hessian of the CNN is more similar to the identity after training rather than the feedforward because of the image understanding priors.
Caridorc Tergilti
Karma: 118
Given that this method returns a numeric matrix, then it must be an Hessian evaluated at a point or the average Hessian of many points. Is the result the Hessian averaged over all training data? Is this average useful rather than just cancelling out high and low Hessian values
You can use the “mp-net2” model from sentence transformers for zero-shot classification (scalar product between the text and the embeddings of “sex” and “violence”) decide a cut-off and you are done.
Thanks for the quick response, have you tried fine-tuning the new llama2 models on the data gathered so far to see if there is any interesting results? QLORA is pretty efficient for this.
It looks pretty cool! Adding a Google sign-in option would greatly broaden the reach of the game as most non-technical people do not have a Github account.
We could not find a “speak in French” vector after about an hour of effort, but it’s possible we missed something straightforward
Did you try 10 or 20 simple French phrases with a positive sign and their translations with a negative sign?
Also try 1000 english words and 1000 french translations in case scale is the problem.
Also try:
“The following text is in English: ′ ”
“The following text is in French: ′ ”
with the second phrase written itself in French.
Very interesting, could you elaborate or give some links?
In my opinion Wearable health is highly neglected because older people are less tech savy than young people, so they use it less than younger people, but they would also benefit much more from the technology. If a 20 year old wears a smart watch that measures and records heart-rate it is almost only for fun, if a 60 year old does it, it could prevent and inform about important issues, but the 20 year old is much more likely to actually use it than the 60 year old.
I also asked ChatGPT, here are the six best ideas that it had (excluding electric bikes, as it was already my idea ;P) (cherry picked by me over 21):
Online education: Online education platforms like Coursera and Khan Academy were mature, widely available, intuitive, and cost no money for basic usage. They also had no regulatory barriers or moral issues and could be used by mutual agreement among one or a few people. Online education also saved a lot of time and played relatively well with the existing format of learning and education.
Digital wallets: Digital wallet technologies like Apple Pay and Google Pay were mature, widely available, intuitive, and cost no money for basic usage. They also had no regulatory barriers or moral issues and could be used by mutual agreement among one or a few people. Digital wallets also saved a lot of time and played relatively well with the existing format of financial transactions and management.
Wearable health monitoring devices: These devices, such as Fitbit and Apple Watch, are mature, widely available, intuitive, and cost no money for basic usage. They also have no regulatory barriers or moral issues and can be used by mutual agreement among one or a few people. They save time and money by allowing users to track their health metrics and stay motivated to maintain a healthy lifestyle.
Online language learning platforms: Platforms like Duolingo and Rosetta Stone are mature, widely available, intuitive, and cost no money for basic usage. They have no regulatory barriers or moral issues and can be used by mutual agreement among one or a few people. They save time and money by providing an accessible and effective way to learn a new language.
Home energy management systems: Devices like Nest Thermostat and Sense Home Energy Monitor are mature, widely available, intuitive, and cost no money for basic usage. They have no regulatory barriers or moral issues and can be used by mutual agreement among one or a few people. They save money and energy by providing users with insights into their home energy usage and allowing them to make informed decisions about energy conservation.
Collaborative writing and editing tools: Platforms like Google Docs and Microsoft Teams are mature, widely available, intuitive, and cost no money for basic usage. They have no regulatory barriers or moral issues and can be used by mutual agreement among one or a few people. They save time and make collaboration more efficient and effective, whether for school projects, business proposals, or creative writing.
Both of them are very reasonable, online education is accessible, almost free, and makes it possible to study even while holding a full time job, from a quick glance a great deal of your requirements are satisfied.
Digital wallets I am less sure about, I never used one, but they look really convenient and easy to use, but I would need more info on how secure they are before starting to use them.
Overall, I think all of these ideas kind of fit your point.
Electric bikes are vastly under-utilized even in European cities where they are safe and effective to use:
Mature: bike more than 100 years old, electric motors and batteries also mature.
Cost no money: saves a ton on money over a car
Was widely available and fairly intuitive for the average person to use: everyone can bike
Had no regulatory barriers or moral issues: clearly not illegal nor immoral to ride a bike.
Saved a lot of money and time: saves also time because there is no need for separate exercise.
Had an immediate payoff: you gain from day 1
Played relatively well with the existing format of
meetingstransportationAppealing largely to people in the developed world with high access to information about useful new products and services: high traffic congestion is common there
Potential daily users in the hundreds of millions: even more, around a third of all persons are potential daily users
The only barriers are perceived risk (not clear if the risk of an accident is higher than the benefit from physical exercise in my opinion, it could well be net positive depending on where you live) and that you look “childish” and kind of weird if you bike to work.
I tried both and neither works
Here is my playthrough with my though process:
:::spoiler
>!0) [2, 4, 6] is VALID
>!Now I think, let’s check if the rule is *2
>!1) [31, 62, 93] is VALID>!Let’s check if the rule is always true with 3 random numbers.
>!2) [6534525, 142536, 456342532] is NOT VALID>!I wanted to check multiply by 3, but I repeated multiply by 2
>!3) [5, 10, 15] is VALID>!Checking multiply by 3
>!4) [7, 21, 63] is VALID>!Checking multiply by 10
>!5) [50, 500, 5000] is VALID>!Now I am thinking: maybe any multiplication is ok? I cannot try them all, let’s try constant addition:
>!6) [34, 35, 36] is VALID>!Let’s try constant subtraction
>!7) [5, 4, 3] is NOT VALID>!Let’s try increasing
>!8) [5, 64, 234] is VALID>!Let’s try increasing with random numbers
>!9) [12345, 123456, 1234567] is VALID>!Let’s try increasing or constant.
>!10) [5, 5, 6] is NOT VALID>!Now I have made up my mind!
>!After 10 tests, your guess was . . .
>!”The sequence is valid if it is strictly increasing.”
:::
CCS does not find the single linear probe with high accuracy: there are more than 20 orthogonal linear probes (i.e. using completely different information) that have similar accuracies as the linear probe found by CCS (for most datasets);
So what about an ensamble of the top 20 linear probes? Is it substantially better than using just the best one alone? I would expect so given that they are orthogonal, so they are using ~uncorrelated information.
The most important thing is approaching other points of view with an open mind, with epistemic humility , that is, knowing that something of what you think can be wrong, even if, from the inside, everything feels right.
On the object level:
Carbohydrates can be: fruit/whole grains/normal bread/normal pasta or North American crazy industrial snacks and “sugar-cereals” and “sugar-bread”. The first one is good, the second one is bad.
No idea about optimal salt levels, just a note on your language: “potentially deadly” is too vague to have a useful discussion. Crossing the road is “potentially deadly” for some definitions of “potentially deadly”. Try to quantify the risk instead, at least approximately.
For facemasks, a surgical mask that you re-use for several day, without cutting your beard (beard makes it impossible to have a perfect fit), with a random size, removing it constantly to eat and drink, of course it is going to work badly. If you wear a serious P100 masks, of appropriate shape and size, with no beard (cut down to zero with a high quality manual razor) and never remove it, of course it is going to work, it is basic physics at that point. If it is a good idea to wear it, considering costs and benefits, is another discussion.
Please be really careful about psychoactive substances, they might have long term effects that are little known because they are little studied. (This last statement is based on random stuff read on the internet, take with a grain of salt).
“”″
That’s when I discovered more effective ways to approach reading, including what I’ll call “Guess-and-Check,” the technique of scanning and making predictions. Instead of trying to read every word in a textbook, in Guess-and-Check you scan the material and make predictions about what you think the text is saying. This active reading process can help you better engage with the material and activate your prior knowledge. After making your prediction, be sure to confirm or correct it by checking it against the text.“”″
This is similar to the way GPT-3 was trained! Pretty cool that you also found it effective!
Yes, the tone of my comment could be improved. I appreciate him for publishing his lessons to the community and wanted to give some suggestions to improve (eventual) future ones, if he feels like the higher quality is worth the higher effort, and with no obligation. “Al caval donato non si guarda in bocca” (You should not look at the teeth of a gift horse (to learn about its age))
Some suggestions:
Use a better marker, what you wrote on the whiteboard is almost unreadable for me.
Expanding on the previous point, write bigger and make better use of the space on the board.
If you have complex graphics, pre-make them accurately and print them out, put them on the whiteboard with weak tape. (What is the weird of bridge at the start?)
Use Whisper to make subtitles to help non-native speakers (as another commenter suggested).
Invest in a tripod to have the camera at a natural height instead of bottom to top.
I did not watch the lectures, this feedback is from skimming around in the first one.
In lecture 3, visualizing the Fourier matrix (Discrete Cosine Transform) matrix, could be really interesting.
Are the lectures ordered by something or following a thread? If so you should make it clear by posting an overview lecture at the start.
Do not wear glasses, it makes you look weird and lose connection to the viewer.
Thanks a lot for your effort, we really need to spread mathematical education for the benefit of the whole society.
In Italy we have this, in the Ferragosto week (around the 15 of August) a huge percentage of people is on vacation. In general a lot of people take vacations in August and schools of all order and levels (including university) are closed the whole month.
Did you use ghost gradients? (gradients that tend to reactivate features that are at zero)