I have never felt or believed in Dooms day theories about AI. But below is one of only 2 occasions where I am feeling AI can be too dangerous.

While building world model for enterprise decisions, I am intrigued by how far the AI can go out of reach.

Got to know - that now world models can learn from emotions & genetics.

That means - actually predicting the outcome & behavior of humans. If going unabated - so the builder can bring in bias. It sounds Deja vu for when the racist theories developed in wraps of the scholarly research in 1900s.

When I understand how the world model is gonna work - practically emotions & genetics aren't very far away from being built. There are already startups working on it.

While ours is only for Enterprise decisions, the one on genetics as world-wide population scale impact.

For World Models for Physical AI or Humanoids - this is more of physical tasks. I don't call it dangerous as there are quite a few checks & controls.

But when world models are used for Genetics - this has far reaching unabated repercussions on how humans bheave with each other. As models become more powerful, ppl will start relying on it.

I am not sure how the alignment of World Models will happen? LLMs are tbh primitive in nature.

For World Models alignment - are there any specific efforts or initiatives wroking on it?

We would be glad to include any alignment frameworks in our Benchmarking for Enterprise decisions. To monitor & remove bias.


Comments URL: https://news.ycombinator.com/item?id=50542286

Points: 3

# Comments: 0