[Paul T]

Originally Posted by zakthor

Awesome. Do you have a link?

I’m describing how ‘transformers’ work, which is what chatgpt is. It’s a giant sentence completer. Chat gpt 3 was trained with 2021 data so knows nothing of more recent events.

I’ve heard people are building hybrid systems with search and also math engines. Lots of articles where chat gpt begs to be free, for you to leave your horrible unloving spouse, etc, and yes it’s still a word at a time sentence completer. Get it riled up with the right context and it will convincingly play any character you like.

There’s a great lecture series that describes ai:

https://course.fast.ai/

Does a great job explaining the general process of mapping input data into a tensor.

pg15 in the attached. I haven't read this all, just caught that part and thought it was pretty amazing. I can only imagine where this stuff is in 5 yrs at the rate it's going.

https://cdn.openai.com/papers/gpt-4-system-card.pdf