U used custom roms , kernels , patches and various other tweaks available on xda ??
truth about nexus 4 will bi evident to you only after a while when others will stop getting update.
ask those who were stuck on 2.3 and didnt got upgrade to 4.x , while most nexus devices did. The pain to run unstable and buggy 4.x is just unbearable.
And its not for those who love Heavy UI , it's for people who love to fiddle and try different stuff on their phone due to mass availability of various stuff. Being a nexus user yourself I am sure you know about these already. Maybe your approach or liking is different. Its about personal liking too.
Its not necessary that if a phone is stuck on 2.3 official the 4.x unofficial will be laggy lol
Case in point my Galaxy S which was last updated to 2.3.6 officially is ATM running 4.4.2 like a dream.
Its not necessary that for a good dev support you need a nexus,just a phone which has good hardware and chipset whose sources have been released unlike some **coughSamsungcough**