It's great for boilerplate, like a snippets+. If I ask it to solve something that's basically straight out of the documentation / walk through, it spits that back at me. Bad at doing the hard work imo. Useless at solving novel problems, or those that don't have a solution already within its data set.

Being limited the way it is - not being able to use a project's greater context, which is millions of tokens generally - is a severely limiting factor that makes it unsuitable for serious work as well. Working around this (figuring out what dependencies to inject into the prompt) is as much work as actually coding.

I can see that it's passed some sort of threshold with the greater population. It is great generating filler text. Just what it can do right now should have many applications.