I'm getting around 90 tok/s on a 3090 using Ollama.

Pretty impressive

Looks cool, the only one similar I've seen so far that is similar is: https://github.com/cyberagiinc/DevDocs

But every-time I've tried to run DevDocs, I've had issues running it. Either the scraper or the MCP server fails to run.

It is pretty sad to hear - we've had solid results with Oracle's Grapeshot (segment audiences and brand safety for programatic advertising).

We were meant to meet them in person next week but got cancelled at the last minute.

I've heard all products will run normally, and everyone still has a job. However, they don't know what will happen in the near future. I assume Oracle is trying to flip off all parts of the business; if not, they'll shut them down.

What sort of measurement setup and process are you running to compare these and properly control your experiments?

It's pretty simple: ROAS (Return on Ad Spend). All our campaigns are performance-based. If one segment provider/SSP does well, it automatically scales spending. Likewise, if the performance drops.

Really, I’ve heard their audience segments were garbage

Fair enough. We run about 10 different providers and automatically scale spend on who works best. Grapeshot is usually up in the top 5 for us.

They were just a dumb pipe for most of their segments, but the bluekai branded segments were better than the completely unverified nonsense you might accidentally buy if you weren’t careful. Addthis was always garbage, dlx is good, etc. just a process of vetting vendors which the hotline used to be able to help with.

We use Oracle's Grapeshot (they acquired them in 2018) which is a solid platform for audience targeting and brand safety for ads.

The product is still working since the news broke this week, and my assumption is they are going to try and sell it on as it's still a solid product and performs wells and brings us nice ROAS (Return on Ad Spend)

You could look into the new Minis Forum MS 01 (which is already on sale?): https://store.minisforum.com/products/minisforum-ms-01

Starts from $549 for the barebones with an i9-12900H. You could argue it is a better option as it has an internal PCIe slot for a half-slot GPU, which will be much less bulk than a mini PC + eGPU. Plus, it would probably be cheaper since eGPUs aren't cheap.

ETA Prime did a review on it the other day: https://www.youtube.com/watch?v=NUlptjU0vFQ

Rockchip's rk3588 is on 8nm: https://www.cnx-software.com/2021/12/16/rockchip-rk3588-data...

Exactly. If you look at YouTube bitrate for a 1080p video, it's 8mbps, which is 1.67% of the theoretical max data rate of USB2 (480mbps), so there's more than enough bandwidth for CarPlay.

Yeah USB3 and greater is really only needed for high res displays and faster large storage.

I remember when he used to live in Auckland (he lives in Queenstown now in some mansion) he could not parallel park to save his life. Used to see his car alot around my old office.

Would be fine if we had a discreet car, but he had a big Black G-Wagon with the number plate DOTCOM. Seems like he doesn't own the plate anymore: https://www.carjam.co.nz/car/?oplate=DOTCOM&plate=D0TC0M

Agree with this. You want something with the least headaches as possible. You should be able to run the the Home Assistant App as well.

If you get a old iPhone and buy a replacement battery still more than likely be cheaper than buying a Rpi + screen + lipo-hat + battery.

This is a good idea. You don't want to have a full-on Linux distro controlling your lights. You want something you can set up and forget.

You will feel a world of pain when there is some bug, and it will take you 8 hours to figure out the issues so that you can turn your lights on. The simplier, the better for these kinds of applications.