I agree 100% with you.
I've always wondered though. What's special about members of the organization 13 is that they remember their past right? Also, Roxas looks almost exactly like Ventus. Lea and Ventus met and became friends. Do you think Axel/Lea remembers Ventus and becomes friends with Roxas because he's familiar?
Normal nobodies do remember their past because they're essentially a "continuation" of their original self yet still different (it sounds weird I know, lol).
Roxas looks like Ventus because Ven's injured, sleeping heart remained in Sora's body when Sora became a heartless and then the body (Sora's body!) took the shape of the heart that remained in it => Ven's.
This means of course not that Roxas = Ventus, Roxas is his own person as is Ventus. Roxas didn't remember his past and coexisted with Sora, so he became essentially a complete new existence, yet he lacks any part of a true existence as everything is "borrowed", body and soul from Sora and (unknown by Roxas) the heart from Ven.
If Axel really would consciously remember Ventus he would see Xion as Ventus all the time, as does Xigbar, not as Xion as he does in Days.
And he would have made surely a remark to someone about Roxas looking so much like Ven if he remembered. (Actually, going solely by looks Roxas and Ven really are like identical twins).
So no, I don't really think Axel remembers Ven, at least not consciously...who he only met for at most 15 minutes several years ago.
Yet I will not deny that maybe some subconscious familiarity (or even the sleeping heart of Ven inside Roxas) drew Axel to him, especially if he really got some emotions through a connection like I suggested above.