Iceberg has the hdfs catalog, which also relies only on dirs and files.
That said, a catalog (which Delta also can have) helps a lot to keep things tidy. For example, I can write a dataset with Spark, transform it with dbt and a query engine (such as Trino) and consume the resulting dataset with any client that supports Iceberg. If I use a catalog, all happens without having to register the dataset location in each of these components.
I share the sentiment, and I also get downvoted every time I post something on those lines here. Only thing that can make you even less popular is saying that using cloud services can make sense depending on your priorities. =D
I wouldn't downvote anyone who says it hasn't worked out for them, but I run what I imagine is a fairly large scale "smart home", ("device" counts in the hundreds), perhaps not compared to the popular YouTubers you see, but still fairly large.
It's worth noting that I _enjoy_ finding ways to automate my home, or create solutions to problems that didn't exist, and using Home Assistant, but my experience has been anything but troublesome.
Granted HA started off pretty rough, and there are ways it does things I still don't think are as good as they could be, but it has come along an incredible amount and they're doing great things at HA/Nabu/Open Home Foundation.
Truth lies somewhere in between. It's also a generalization to think everything related to the “evil-nation” postulation is nothing beyond a conspiracy theory. Absence of evidence is not evidence of absence.
Edit: quoted evil-nation since it’s a debatable term usually applied to any country not politically or culturally aligned with some intelligence activity presence.
Correct. Not more, not less. Question is what the default assumption is. With enough BS thrown around, the public seems to tend to tilt to "something is fishy" without any (non-debunked) evidence having ever been presented. Doesn't mean it never will be, but until then, a lot of debunked falsehoods shouldn't create more bias than just silence. Sadly, something always sticks.
fundamentally, it’s a ‘liberal’ (assume good intent/turn the other cheek) vs ‘conservative’ (cover your ass) approach. In the literal, not political meaning.
With enough problems, enough people get burned that of course this is where it goes.
Title could be “Nobody cares about the same things that I do”. Or simply “Nobody agrees with me”, which also would be exaggerated, but slightly less myopic.
Hah, plus one on this one. Once I went as far as buying a French car famous for the suspension problems due to the terrible quality of pavement in my country, mainly to prove everyone was wrong about the unreliability claims (and it was unreliable btw). I guess I was often feeling I was outsmarting the dumb crowd... got me screwed so many times.
I love Home Assistant but I now have a pretty strict minimum effort rule after years of configuring integrations and building dashboards that I would forget about after 2 months:
I only do automations (no dashboards at all), and try to keep them as simple as possible. Once I feel I’m reaching diminishing returns territory, I stop.
Only use HA if I need to mix different vendors (e.g. turn on the hue lights if the tuya sensor switches to on) or if the vendor app/service has a limitation that doesn’t allow me to do what I want. For instance, I have some automations for my Mitsubishi airco units cause their app sucks. Otherwise I’ll just use the default app or service.
Only configure an integration if I’m going to use it in an automation; I have a bunch of integrations detected that I don’t configure.
I decided to follow these rules a couple of years back, and since then I could address all my needs with almost 0 maintenance.
How many apps do you have installed to control everything? And how is the stuff integrating if you have equipment from different vendor that need to talk to each other, like AC units with PV inverter to start and shutdown based on electricity net production and real temperature in the rooms (using external thermometers, not the one in the AC)? And how do you consolidate and monitor power consumption in a single place, are you using a different solution for that?
It sounds like I use HA in a similar manner. For me, I make HA available to Google Home and HomeKit. HA is just glue to hold everything together.
I tried do make a dashboard some time ago but it felt rather complicated. Google Home and HomeKit integrate the best into my life and the lives of my family that there is no way HA can compete. Maybe that will change if I find myself in a house that I own… Maybe spending time to make a dashboard will have a better value prop.
I assume then, you don’t use HAOS? What benefit do you see by managing your config this way? Do you also have an operator to reload HA when when you update configs?
You can buy only a replacement mug (without coaster/charger). Also, get in contact with customer support mentioning the battery, they usually offer a discount code.
I had to deal twice with them: coaster stopped working 2 years ago and more recently paint inside the cup came out. Both time, they replaced the broken part at no cost. Probably the first time in my life I'm using and happily recommending customer support of any kind.
Ways I found that helped me the most dealing with this kind of situation:
- Refine your definition of what’s “meaningful”: anything that helps you, your colleagues, helps you to learn a new thing or simply allows you to create something beautiful can be meaningful; there’s a lot of meaning in giving a meal to someone starving, even though you’re not solving any big societal issue or being applauded by many for that single act.
- Don’t take people like the OP’s first manager too personally: with time you realize they’re generally not evil or terrible human beings, they’re just in a different mission. Usually they are also as lost as we are, trying to find meaning and recognition. Just lower the importance you give to them (if you’re really incompatible with their personalities) and focus on your work. If even then it becomes toxic, then move.
- Most importantly: reshape your relationship with work. Who you are and what you do are not necessarily the same thing. I don't like the advice of "slacking and collecting your pay check" (been there, you also feel shit after a while), but I think that going a bit to that direction helps to find balance.
That said, a catalog (which Delta also can have) helps a lot to keep things tidy. For example, I can write a dataset with Spark, transform it with dbt and a query engine (such as Trino) and consume the resulting dataset with any client that supports Iceberg. If I use a catalog, all happens without having to register the dataset location in each of these components.
reply