The thing is, he is just a databank, kind of like the Memory Tree on Pandora. I did not agree with Sam's argument that if the NK wants to destroy the world of men, he should start with Bran. The whole idea that Bran's stories are not just stories did not make sense to me. Sure, the brain is a much more complex structure, but a simple book is more lasting, even given the long life spans of the Three Eyed Ravens (considering Blooraven was the previous one). Additionally, Bran has to look back into the history or his own memories, it is not like his brain is synthesising all of it at once, in which case he would be even more creepy and say even more outlandish things. Bran is just one person, with a limited amount of interface possible, he can only have conversations with so many people at a time. Destroying the Citadel for example, would be a much more effective way to start destroying the world of men, even while going by Sam's logic. At the same time, trying to reconcile science with a fictional fantasy world does not always work out well, but this particular universe was written exactly for this kind of analysis. So then, the other way to look at it is to be suspicious, something that we learned from LF. What can Bran hope to achieve by selling everyone the fact that he is the world's memory. He seems to have no personal goals beyond self preservation, and seems to look upon his "condition" as something of a curse. Eventually, when you think too much about it, it all stops making sense, so I stopped thinking.