I love this! looked into doing a similar project, you're competing against Hudl but using the phone instead of custom hardware (always preferred). Highlight segmentation may be a challenge with SOTA cv methods, but there are lot of directions you can go in.
Yeah Hudl is definitely a beast in the space though I think of them as almost more focused on orgs and teams rather than consumers.
Re: highlight segmentation was and still is a challenge that we work on. In the beginning we had a hard time dealing with false positives when our models thought a shot was in but it wasn't. This has gotten better over time with more data and is hovering near 92% acc these days but obv not 100%. But i'm optimistic as data grows and the sota methods get better, this isn't the hardest ml problem in the world
A few thoughts as I've done academic research & built products in this area:
- if you're using SMPL body parameters this will have to stay research / open-source
- is this leveraging some sort of monocular depth estimation to estimate the wall in 3D space? Also, do you have assumed camera parameters, or is that also estimated? If there isn't any depth information, this will be highly inaccurate on any cliff routes, but still useful on flat wall climbing.
Overall, a good idea (that I've also thought about building as a climber) - the tricky part that I'm impressed you have a solution to is path planning up the wall. Even assuming a flat wall with no depth estimation, it's still looks effective.
This is an end-end system that just takes in video frames. Camera parameters are one of the things that is predicted. It gives promising results for a wide variety of environments (cliffs, diff types of bouldering walls, diff outdoor walls, etc.), though not always accurate. Path planning is also part of the end-end system. Will share more details in the paper.
commercial license - the research group formed a corporate entity that licenses the body model and all derived work (SMPL-X, etc.): https://meshcapade.com/SMPL
sell enough units to convince Khosla Ventures that you aren't just burning their money, forcing them to double down on the vision and bring in new investors for the next round. Rinse and repeat until the Large Action Model is either extraordinarily valuable or you've torched all the money.
It's true, lack of highly available public transportation between the cities puts us behind other regions (not to mention other countries). I've been doing the ATX -> HTX drive for years.
Best private alternative I've found is Vonlane (https://vonlane.com/) - takes longer than flying but it's a business class bus so you can get work done.
Joining the nuance parade - Google expanded their entry points to Search years ago via Maps and the URL bar.
Do I use Google traditional Google Search (google.com) to find things? Rarely. Do I use Google Maps to find bars / restaurants / order food? All the time.
I guess the nuance is what we're trying to find. LLM's swallowed the listicle - I don't need google.com to find an autogenerated list of "best restaurants in London". But if I'm in London at at lunch, and I need a coffee nearby, it's still useful.
I also purchased and read this. If you enjoy the minutae of scientific advances you’ll love this, but not a page-turner. Also a helpful scientific / historical primer for anyone who wants to understand graphics (pixels, shaders, etc)
This is great, but how is your performance on multi-table joins? We've been working on a homebrew solution using OpenAI internally conditioned on our schema, and can't bridge the multi-table gap.
Also I'm skeptical if this generalizes, do you have measures in place to prevent query hallucination?
On simpler multi-table joins we've been able to product good results, and we've done a lot of prompt engineering to make sure it takes the schema very seriously so that prevents hallucinations too. We're always finding new edge cases and fixing those as we go.
A Little Life - challenging to read but exceptional
Sci-fi
Three Body Problem trilogy - forget the Netflix series the books are excellent, in my opinion #2 was the peak.
The Glass Hotel, Station Eleven, Sea of Tranquility - anything by Emily St. John Mandel - hard to place but her distinct writing style transports me.
Non-fiction:
American Moonshot - fine The Path to Power - anything Caro writes is worth reading
reply