I'm a sucker..
I would still go out to dinner with him as friends..(unless you think hes a creeper?)
He probably is just lonely and wants a friend..
Just be friends.. and have a good time. Never know... maybe you will end up seeing something different in him when you all go out. Its happend...