The biggest problem with things like this, which almost nobody talks about in the context of investing, is publication bias.
100 people try to develop a profitable trading algorithm. 1 comes up with one that looks great on back-tests at a 1% confidence (in other words, exactly what you'd expect from random chance alone over 100 trials).
That person writes an article/pitch/business plan based on their algorithm. You never see results from the 99 who failed.
Going forward, the successful algorithm is no more likely to work than the failed 99, but from the perspective of the general public it sure looks like a winner!
There's an old con game - you send 500 letters to gamblers, predicting the next Dodgers game. 250 predict they'll win; 250 say lose. Game happens, 250 people think Hey lucky guess. To those you send 250 letters, 125 predict they'll win the next game; 125 lose. After 6 games you have 8 people who have seen you guess right 6 times in a row. Get them to pay you for another (worthless) letter.
So much this. Also even if you have won it means very little going forward. If you put 100 guys in a room and asked them to try to flip N consecutive tails one guy will come out thinking he is the king of flipping, with a rock-solid "system". He's just someone who doesn't understand probability. And as you say you don't hear from the other 99 including the math guy who flipped N/2 heads and is muttering about it.
> 100 people try to develop a profitable trading algorithm....
It's much worse than this with machine learning approaches. Imagine a million people trying to find a profitable algo, all on your laptop, and you are choosing the best one out of all of those.
If you are used to pen-and-paper trading strategies, or even excel spreadsheets, machine learning is just a completely different level to this. And probably how it works will be unintelligible to anyone. I don't even see how someone can write a business plan based on this.
The type of approach used has limited effect on survivorship bias, what matters is the number of people employing different approaches and the size of the effect. So if machine learning approaches can produce real results, the data will show this. Survivorship bias is real, but it is not the full story.
Yes, like the fact that there is not a single accessible Uber vehicle in New York City... we THOUGHT the ADA had outlawed that sort of thing, but apparently not.
'Truckers have to deal with a sort of standard "road safety dilemma" all the time...'
I think you mean that truckers FEEL like they deal with that dilemma all the time. If they ACTUALLY dealt with an A or B dilemma, they would routinely end up in situation A or B: running over a passenger car or flipping the truck. It happens SOMETIMES, but infrequently.
In reality the situations where other drivers do something stupid are probably much better handled by the self-driving truck, which doesn't panic, doesn't feel a fight-or-flight response, doesn't overstate the gravity of the situation... doesn't do anything except assess what to do next without emotion.
Without more context, the information here is titillating but not ultimately all that useful.
Let's generalize the content so you can see what I mean:
"A massive trove of documents was just leaked from a law firm that helps companies and individuals create and operate shell companies in [jurisdiction X]. We don't know what those shell companies are used for, but they could be used for wrongdoing! And this law firm was suspiciously focused on protecting its clients' identities, which further suggests wrongdoing."
Jurisdiction X in this case in Panama. Ok, it sounds dubious to us 'Muricans.
What if jurisdiction X was Delaware? Would you think the law firm was setting up shell companies for "wrongdoing", or because starting and operating a business is complicated and there are a variety of practical reasons to base your corporate in entities in Delaware rather than (say) Maine? Would you think the law firm is protecting its clients identities because of an effort to conduct fraud, or because law firms generally err on the side of preserving the sanctity of attorney-client privilege whenever possible?
Now let's say Jurisdiction X is Ireland. Are the companies that use Irish shell companies engaged in wrongdoing? Or are they responding to the bizarre and complicated world of international regulation and taxation as any rational actor would? Certainly secrecy is not the goal - everyone, including the IRS, knows everything about how e.g. Apple uses Irish entities to conduct business.
Now let's say Jurisdiction X is Cyprus. Are the shell companies for tax avoidance in the home country, or for the reasonable avoidance of double-taxation? One reason investment firms use structures based in Cyprus (or the Caymans, or BVI, or Luxembourg) is that these countries have mutual tax treaties with most Western nations, while the US does not. Those tax treaties ensure that the investor will end up paying taxes only in their own domicile, not the nation they invest in AND their own domicile. For US persons investing in (say) Poland through a Cyprus entity, they end up paying their full slate US taxes (NOT avoiding them - in fact they usually pay higher US taxes than they otherwise would, because for technical reasons the Cyprus blocker often results in paying ordinary income tax rates on what would otherwise be treated as capital gains) but they avoid having to pay BOTH Polish taxes AND US taxes. This is akin to the reasons why many/most private US businesses are set up as pass-through entities rather than corporations - avoiding double taxation is not the same as dodging taxes.
*
I'm not an expert on Panama, or international tax for that matter - I just have some experience dealing with these issues. So I can't say for sure in what specific purposes using a Panama entity is equivalent to using a Delaware entity or a Cyprus entity, vs. a blatant attempt to dodge taxes.
All I know is that, from my own experience, there is a huge gap between the public PERCEIVED reasons why companies and individuals establish overseas shell corporations (tax avoidance! money laundering! bribery!) and the ACTUAL reasons they do so (procedural efficiency, clear legal rules, full payment of taxes but not OVERpayment of taxes, etc.).
BayesDB and BQL are great ideas in theory. But the problem with building any "general" analysis tool to abstract away underlying complexity is that it must either be (a) a least common denominator solution, or (b) the proverbial hammer to which everything will look like a nail.
The reason why there are lots of different statistical methods is that different problems and different samples from different populations call for different approaches. And frequently the reason why a certain approach is invalid in a particular use case is subtle, difficult to explain, and easy to miss. Abstracting that complexity away from the would-be "scientist" is an invitation for them to develop unreasonable confidence in their results "because the model said so." We have more than enough of that attitude already, thank you very much.
This (partly) explains a major paradox I see: all the best software engineers I know are over 50, and yet the young'uns who dominate the tech zeitgeist assume these same people are incompetent dinosaurs. The young'uns have reached the expert beginner stage, and because they assume they're experts, they refuse to seek out the actual experts to discover what it is they don't know. And if the young'uns ARE the experts, and older developers aren't part of their in-group, then by definition the older developers must not be experts.
This is why I (for one) am strongly biased towards hiring older developers.
All the best software engineers I know are over 50, and yet the young'uns who dominate the tech zeitgeist assume these same people are incompetent dinosaurs.
With age comes experience and also comes a strengthening of biases. Older people, so the stereotype goes, are inflexible and set in their ways, if very experienced in those ways.
It's not really paradoxical, it just depends on what tradeoffs you're willing to make as the person responsible for hiring, which depends on your line of business. There are few things more tiresome than someone making mistakes you already made two decades ago and tried to warn about, and the same applies to someone ignoring the new and improved ways to get things done just because they've always done it that way and know it the best.
"With age comes experience and also comes a strengthening of biases. Older people, so the stereotype goes, are inflexible and set in their ways, if very experienced in those ways."
Like most stereotypes, it might be true in some cases but far from universal. The literal two best developers I know, both over 50, are FAR from set in their ways. They are both constantly seeking new ways of doing things, exploring new languages and technologies, sometimes playing with low level projects (like making lights blink in interesting ways on breadboards), sometimes playing with high level projects (spawning hundreds or thousands of cloud instances to see how it works), but always looking for new things.
They might SEEM set in their ways when they shoot down bad ideas from expert beginners, but that's only because the expert beginner is confusing wisdom for lack of flexibility.
I have given this some more thought and my theory is that probably most of the currently young devs will turn into old developers that will have stooped learning a long time ago. I guess that's the natural progression of things. Most people stop learning at some time. It happened to people who started 30 years ago and it will happen to the currently young hotshots too.
As an over-50 programmer who likes to learn, I'm gonna talk about something totally unrelated to programming...
I'm a musician. I've been playing guitar since I was a teenager. As a technician, I've peaked out. I will probably never play faster, cleaner, or more complex than I do now. If anything, I'll start to go downhill as age takes its toll on my hands. But as a musician, I'm always getting better. I'm growing more conscious, more sensitive, more subtle, more sophisticated. I'm a better musician now than I was a year ago, and a far better musician than I was five years ago.
There's a similar thing in software. When you're still learning, still approaching real expertise, it's easy to think that being a great software engineer is about technique. It's not. I know a bunch of over-50 programmers. Sure, many are basically dead in the water, but many are not, and are constantly improving. It's not because they learn a new language, or a new framework. It's because they learn better taste. They learn more and more what is and is not important, how long things will take, best use of resources, translating requirements more effectively... these things will all make you a better engineer than writing glorified Hello Worlds in framework-of-the-month ever will.
We just had a young applicant who apparently had technical chops (I wasn't interviewing), but everything as "boring". This tech is "boring", that tech is "boring".
The best older developers are often really interested in new things. The real separation is more Hubris vs. Expertise. An expert knows how to get something done so they may take risks with a fall back option. Younger developers often have no fall back option other than just blowing deadlines or working at 2AM.
In the end the real 'problem' with older developers is they expose problems with your organization by providing what you ask for. If you keep asking for tight deadlines thinking people are going to ignore them you squeeze out creativity.
Sadly the older developers I've come across still write code the way they were writing 25 years back, without any regard for changes and newer developments in their chosen languages/DBMS. I've had to spend days convincing them to move to using newer language/DB features, feeling like I'm banging my head against the wall
From what I'm reading (OK, maybe I just watched it in a Brain Games episode) the inflexibility of the old brain is not as set as previously believed (you can teach an old dog new tricks).
> all the best software engineers I know are over 50
Survivorship bias? Perhaps all the bad 50-year-old programmers transitioned out or became "incompetent dinosaurs" in low-challenge areas where you can't easily see them.
If so, it's the cohort I see (the "survivors") that are routinely underestimated by tech bros. Which suggests the problem is even worse: if it visibly affects the best of the best, how bad is it for the average?
I think that you should add:
"Listen to your parents when you have to make minor life decisions".
Way too many people either try too hard to please their parents, or ignore their advice entirely. With time, you learn to not swing too much either way.
Well you're just engaging in the tactic of discrediting the defenders. You must be one of the foreign agitators threatening the community.
Then again, the authoritarian dictator has to play up the credibility of the foreign agitators so they seem more real. I must be a member of the regime trying to consolidate power.
The biggest problem with things like this, which almost nobody talks about in the context of investing, is publication bias.
100 people try to develop a profitable trading algorithm. 1 comes up with one that looks great on back-tests at a 1% confidence (in other words, exactly what you'd expect from random chance alone over 100 trials).
That person writes an article/pitch/business plan based on their algorithm. You never see results from the 99 who failed.
Going forward, the successful algorithm is no more likely to work than the failed 99, but from the perspective of the general public it sure looks like a winner!