1) I do a lot of scraping, and Go concurrency + Colly has better performance
2) My DB size is exploding and I have limited budget, and it looks like CH is so much better at compressing data. I recently did a test and for the same table with same exact data, MySQL was using 11GB, ClickHouse 500MB
That's pretty typical best case size for weblogs and other time ordered data where column data correlate with time values. You do have to tweak the schema a bit to get there. (Specifically a "good" sort order, codecs, ZSTD instead of LZ4 compression, etc.)
You're right and I will still use it, but only for more limited scopes.
I've also cancelled my Claude subscription recently, but for different reasons - it doesn't have the "memory" feature that makes ChatGPT so much more worth it at the moment.
I hope we get to that "10x better" point. I think the problem right now is people advertising LLMs as if we're there already. And it's not just the providers, it's also the enthusiasts on X/Reddit/etc that think they have found the perfect workflow or prompt.
Just like you're mentioning "maybe better prompt engineering", I feel like we're being conditioned to think "I'm just not using it right" where maybe the tool is just not that good yet.
Well "I'm just not using it right" is a perfectly reasonable thought for a new technology. Isn't this the default? When new powerful tools come along, they often fit awkwardly into existing processes.
Technologies: PHP, Laravel (10yrs exp), VueJS/NuxtJS, AlpineJS, MySQL, TailwindCSS, AWS, Azure, RESTful APIs, Adwords, GA Ecommerce, Git, Twilio, Stripe, Docker, Replicate APIs, Openrouter (and other AI APIs).
Started working with Go and Clickhouse in the past 6 months as well.
I have 15 years experience in full stack web development, I have managed small dev teams and have been a one-man IT department for small startups and non-profits. I love building products and creating value.
I've been doing a mix of client work and SaaS building in the last couple years. One project you might have seen on here: gumtrends.com - built with Laravel, took me 6 days from idea to finish and made it to HN front page.
I'm looking for projects / part-time opportunities.
1) I do a lot of scraping, and Go concurrency + Colly has better performance
2) My DB size is exploding and I have limited budget, and it looks like CH is so much better at compressing data. I recently did a test and for the same table with same exact data, MySQL was using 11GB, ClickHouse 500MB