I have no idea if we’ve hit a hard wall, I’m not really on the data science side of things (unfortunately). I think it’s interesting that by default NNs answer the question of “is this a picture of a dog?” the same way a human might-- ie. with a high value if it’s very much a dog, or a lower value if it’s “dog-like” or a very low value if it doesn’t seem like a dog at all. And while Bayesian classifier and other such things do something similar, I usually think of a lot of algorithms as providing discrete responses, which NNs generally do not provide.