Yes, though display clarity will not be as good as with a monitor. Not very useful for reading small text, but can provide large-screen gaming experience if you don't have a big monitor.
Many cards have only S-video out which cannot be directly connected to the composite video input of many TVs. The two XFX cards I received from my supplier last week have only S-video out but came with an adaptor cable for connecting with composite video-in.