Clark Benham

Karma: 34

Clark Benham Apr 16, 2025, 9:21 PM
2 points
0
on: Frontier AI Models Still Fail at Basic Physical Tasks: A Manufacturing Case Study
I think you’re asking the VLLM to do too much in a single call.
I was trying to get the VLLM to extract GD&T data from the NIST standardized renders of ASME Y14 tolerancing standards (eg. screenshotting 1 page at a time from https://www.nist.gov/system/files/documents/noindex/2022/04/06/nist_ftc_06_asme1_rd.pdf ).
Asking “List all GD&T and their matching element IDs” would totally fail, but would start to be reasonably when I only asked for 5-8 specific element ids at a time, and asking for the data of a single element id at a time with few shot examples would be ~90% accurate.
While right now you have to build the scaffold for them to perform well, eventually an agent could realize it needs to build it’s own scaffold or the model would be able to effectively use all parts of the context window.
I’d be curious how well the models do if you wrote out a 7 step list, and then asked about each step in isolation, and then asked a model to summarize the results of 7 separate calls.

Clark Benham Dec 23, 2024, 3:18 PM
1 point
0
on: The Best Textbooks on Every Subject
Subject: On practical machine learning, taking you from the 101 to being aware of practical edge cases before using in business settings. The parts of MLE you wouldn’t get from coding tutorials or math.

Recomend:
1. Chip Huyen’s Designing Machine Learning Systems: An Iterative Process for Production-Ready Applications. Very well structured and complete. The GitHub repo also has links to practical production blogs.
Over
1. Machine Learning Engineering by Andriy Burkov. Not quite as full or well written as Huyen’s, but did cover slightly different topics (eg always need cohort plots; use Kaplan-Meir to estimate cohorts; more talk of agreement metrics; how to calibrate models and how calibrated models are easier to monitor)
2. Machine Learning Design Patterns by Michael Munn, Sara Robinson, and Valliappa Lakshmanan. Was basically only an introduction to Big Query syntax and GCP offerings. Though the section on data split was a little better than the other 2.

Clark Benham Jul 26, 2024, 6:33 PM
2 points
1
in reply to: Clark Benham’s comment on: Universal Basic Income and Poverty
“The system will always grind you down”, but you’re allowed to opt out and it’s getting easier all the time.

Clark Benham Jul 26, 2024, 5:59 PM
7 points
3
on: Universal Basic Income and Poverty
You give the constraints of the middle class worried they’ll slip down, not the poorest Americans directly. If 12% of Americans live in poverty, then the example concerns are those of the 12-50th percentiles. You say the lumpen-proletariat will always exist, but prove that the lives of the proletariat won’t improve much.
“credentialist colleges that raise their prices to capture more and more of the returns to the credential, until huge portions of the former middle class’s early-life earnings”—Explicitly not the poorest.
“Like working 60-hour weeks to afford rent somewhere the school districts will damage your child less”—but a lot of people’s kids do go to the worst school districts. I’d say if your kid goes to a bad school that’s poverty, not the person who sends their kid to a better school.
“rents in San Francisco would almost instantly rise by the amount of the UBI; no janitors in the Bay Area would be better off as a result”—But housing prices over all of the US won’t rise by the amount of UBI. Some would move out of SF to cheaper areas. They’ve been given an option they preferred so their lives have improved. UBI only does them no good if everyone choose to stay in SF, but why would they?
“maybe the Ferguson police departments of the world, just raise their annual quota for fines per capita by the per capita UBI.”—This assumes the policing level is set by the wealth of the poor. I think it’s set by the level that generates political opposition. Claims there’s on 12% as many arrest warrants after 6 years, clearly a political decision not a reduction in wealth. The Police in Beverly Hills are not stationary bandits nor are SF Cops making more in fines. I don’t think it’s a law of history that governments automatically grind down any surplus the poorest have.
The example of Anoxistan relies on the people not being able to afford the most necessary Oxygen, if they had to work 60 hour weeks to get cars, and some people choose to forgo cars, then that’s clearly an improvement.
The idea that poverty is squeeze from the tightest constraint, not the average of constraints is interesting, but you don’t talk about the tightest constraint on the poorest. I suspect those have eased up: look at average hours worked, or the labor participation rate, or stories of the voluntarily homeless who work 3 months a year. All indicate that some people choose not to work much, thus their constraints are smaller.

Clark Benham Apr 23, 2024, 4:37 PM
8 points
6
on: Rejecting Television
“the addicted mind will find a way to rationalize continued use at all costs”
Alan Carr wrote a series of books: “The easy way to quit X”. I picked up one since I figured he had found a process to cure addictive behaviors if he could write across so many categories. I highly recommend it. The main points are:
1. Give you 200 pages explaining why you don’t actually enjoy X. Not that it’s making your life worse but gives you momentary pleasure, you do not enjoy it.
  1. I assume it’s hypnotizing you into an emotional revulsion to the activity, and then giving you reasons with which to remind yourself that you don’t like it.
2. Decide you will never do/consume X again. You don’t like it remember? You will never even think if you should X, you’ve decided permanently.
  1. If every day you decided not to X, you’d be draining will power till one day you’d give in. So make an irreversible decision and be done with it.
It’s a process easily transferable to any other activity.

Clark Benham Dec 1, 2023, 9:18 PM
3 points
0
on: How have you become more hard-working?
I found that installing 3 website blockers at once on my laptop worked for me: the same way you use multiple anti-biotics at once to combat resistance. I might’ve trained myself to disable 1, then disable 2, then disable 3 if I added another whenever I realized the blocking wasn’t working: but by adding all 3 at once I wasn’t going to unblock all 3. Now it’s been long enough I’ve probably forgotten what I’d even need to do to unblock it.

Clark Benham Nov 11, 2023, 10:23 PM
1 point
in reply to: philip_b’s comment on: Insights from Linear Algebra Done Right
The one thing the duality section was connected to was Riesz representation theorem. Riesz states every finite linear functional φ has a unique vector f, such that for all v, φ(v) = <v,f>. It gives an isomorphism from functionals to vectors for a given norm, as the function is just multiplication with the vector.
It’s not tied to the section on duals in the text, but the section on duals lets you appreciate the result more.

Clark Benham Nov 8, 2023, 8:21 PM
5 points
2
on: Thinking By The Clock
The converse of fast paced conversations leading people to say stupid things is: if someone says something foolish it maybe not be a lie nor a tendency to BS nor stupidity. They may have responded faster than they thought. You can correct them not by refuting what was said but allowing them a moment to reconsider. A liar, politician, and fool are hard to reform or work with. “Stopping to think” may be easier trained and much easier used to keep a conversation on track.

Clark Benham Jan 10, 2022, 8:08 AM
1 point
in reply to: SimonM’s comment on: Two ominous charts on the financial markets
The 2000-2021 VIX has averaged 19.7, sp500 annualized vol 18.1.

From a 2ndary source: “The mean of the realistic volatility risk premium since 2000 has been 11% of implied volatility, with a standard deviation of roughly 15%-points” from https://www.sr-sv.com/realistic-volatility-risk-premia/ . So 1/3 of the time the premia is outside [-4%,26%], which swamps a lot of vix info about true expect vol.

-60% would the worst draw down ever, the prior should be <<1%. However, 8 years have been above 30% since 1928 (9%), seems you’re using a non-symetric CI.

The reasoning for why there’d be such a drawdown is backwards in OP: because real rates are so low the returns for owning stocks has declined accordingly. If you expect 0% rates and no growth stocks are priced reasonably, yielding 4%/year more than bonds. Thinking in the level of rates not changes to rates makes more sense, since investments are based on current projected rates. A discounted cash flow analysis works regardless of how rates change year to year. Currently the 30yr is trading at 2.11% so real rates around the 0 bound is the consensus view.

Clark Benham Jan 9, 2022, 4:51 PM
1 point
in reply to: SimonM’s comment on: Two ominous charts on the financial markets
Options Nitpick: You can’t use equity index* option prices as true probabilities because adding hedges to a portfolio makes the whole portfolio more valuable. People then buy options based on their value when added to the portfolio, not as individual investments.

The first reason option hedges make your portfolio more valuable is preferences: people don’t just want to maximize their expected return, but also reduce the chance they go broke. People don’t like risk and hedges reduce risk, ergo they pay more to get rid of risk. However you can’t just subtract X vols to adjust as this “risk premia” isn’t constant over time.

Secondly hedges maximize long term returns (or why you shouldn’t sell options) You want to maximize your average geometric annual return not average annual return. You care about geometric averages because if for 3 years your returns were +75%, +75%, −100%, your don’t have 50% more money then when you started but 0. The average of annual returns was 10.7% over the past 30 years, but if you’d invested in 1992 you’d’ve only compounded at 8.5% year till 2022.

Geometric returns are the the nth root of a product of n numbers and have the approximation = Average Annual Return - (variance/2). If you could reduce variance and not reduce Annual returns, your portfolio (market + hedges) would grow faster than the market.

These reasons are why despite the worst Annual return being −48% in 1931, you say there’s a 5% chance of > −50% returns based on option markets.

*I’m specifically talking index options because that’s the portfolio investors have (or something similar) and the total is what they care about. If you were to use prices as true probabilities for say a merger going through these reasons don’t apply as much and would be more accurate.

PS. I’ve referred to investors as all having the same portfolio because most people do have highly correlated index holdings and it’s at this level of generality you can think about investors as a class.

Clark Benham May 22, 2021, 7:26 AM
5 points
1
on: Book Review of 5 Applied Bayesian Statistics Books
This would be useful as a comment on https://www.lesswrong.com/posts/xg3hXCYQPJkwHyik2/the-best-textbooks-on-every-subject, not sure of best way to update existing lists though.

Clark Benham Apr 12, 2021, 4:39 PM
1 point
in reply to: ballerburg9005’s comment on: IQcaptcha enters beta
new design without the quote looks fine.
I seem to be having a bug though/ironically am not able to solve it; I got the matrix that is F9 here https://www.dbglab.ru/en/slovar-dannykh/61/130/ (answer is 5)
My function f(x) = 5x³ + 14x² + 8x + 20 → f’(x) + x = 15x² + 28x + 8 + x = 528 is being marked incorrect.

Clark Benham Apr 7, 2021, 6:51 PM
3 points
in reply to: ballerburg9005’s comment on: IQcaptcha enters beta
just pull something (and quickly) from the Flat Earth Society; https://www.extremetech.com/extreme/259821-flat-earth-society-trolls-elon-musk-claims-mars-round
is a prime example

Clark Benham Mar 22, 2021, 7:36 PM
1 point
in reply to: Gerald Monroe’s comment on: The EMH is False—Specific Strong Evidence
No, it’s lower than the normal “8%” you hear because I’m not averaging across time.
[+10%, + 1%, +9%, +20%, 15%] = 9% if you average the percentages, but this represents putting in $100 at the start of each year and selling any excess gains at year end. The way people invest of putting in $100 once and letting it compound* gives
1.1*1.01*1.09*1.2*1.15 = 1.6711662 total gain or
1.6711662^(1/5) = 10.8% annualized.
The technical terms for this is non-ergodic see https://jasoncollins.blog/ergodicity-economics-a-primer/ for a description.
*Actually people do even worse then this, particularly for hedge funds: individuals put money into hedge funds that recently outperformed but go on to reverse to the mean and underperform. So while the average annual returns are +30% −6% = 12% annualized, pretty good across time, but if you did 30% managing 100M and −6% on 1B then the dollar returns are net negative.

Clark Benham Mar 18, 2021, 8:25 PM
16 points
in reply to: romeostevensit’s comment on: The EMH is False—Specific Strong Evidence
It seems deluk is investing with Bitfinex (blocked in US), which has lots of ongoing issues; see Patrick McKenzie on why the whole thing is a fraud that is down several hundred million and is likely to seize accounts https://www.kalzumeus.com/2019/10/28/tether-and-bitfinex/ .
IIRC some individual investors in Binance (also supposed to be blocked for US investors) were being targeted for investigation by CFTC; there’s an aspect of lending that lead to Know Your Customer violations (very hazy on specifics).
A legal way to put on this trade is to short MicroStrategy (Co that bought bitcoin) and buy bitcoin yourself. https://www.coindesk.com/microstrategy-bitcoin-michael-saylor-valuation

Clark Benham Mar 18, 2021, 8:15 PM
1 point
in reply to: Dan Weinand’s comment on: The EMH is False—Specific Strong Evidence
That’s a very selective term history; the exact bottom of the SP500 from Covid fear was March 20 2020, vs todays March 18th. Unless you put in everything on March 18th this is highly misleading. The true comparison would be your annualized dollar weighted average return (but for Schwab at least this isn’t easily calculatable, as saving is counted as increasing portfolio weight, and buying increases the base investment, but without a proportional change in ‘Total gain’).
Since 2000 the average annual return of the SP-500 is 5.9%(6.1% for VTI since inception) and a reasonable approximation of what would be earned going forward.

Clark Benham Dec 3, 2020, 11:35 PM
3 points
on: In Addition to Ragebait and Doomscrolling
There’s a similar pattern in Rap music, the misanthropic self promotion. The message of basically every lyric is either “I’m super successful” or “I know no bounds in what I will do”; either case has the listener emphasize with the sentiment of being better than others/not caring about others. I stopped listening when I noticed the avarice it was promoting, how I could only fantasize about being a $MM success, which not having a path to improve toward just gives the fantasy of becoming $MM.

Clark Benham Jul 14, 2020, 12:31 PM
4 points
on: Limits of Current US Prediction Markets (PredictIt Case Study)
EDIT: NVM. This is just proof I didn’t get enough neonatal iodine.

For Section 2 on transaction costs you write the calculation for probability of winning is:
100 / ( ( ( 100 / 0.40 ) * 0.9 ) + 10 )
Where does the extra +10 come from?
EDIT: It’s so that you’re not paying taxes on the amount of the original wager.
maximum_%_bet_on_P = bet_amount / (conditional_winnings—fees )
= bet_amount / (conditional_winnings(1-fee%) + bet_amount*fee%))

Clark Benham Apr 17, 2020, 1:27 AM
2 points
on: Integrating Hidden Variables Improves Approximation
Doesn’t
D_KL(P[X]||Q[X])≤E_Y[D_KL(P[X|Y]||Q[X|Y])]
mean that you can’t expect to improve by integrating in additional information Y?