13 Nissan (Pesach)

The passuk the Haggada uses to show "Vayareiu osunu hamitzrim" (and the Egyptians did bad to us) is "Hava nischakma lo, pen yirbeh vihaya ki sikrena milchama vinosaph gam hu al soneinu vinilcham banu viala min ha'aretz" (Let's deal cleverly with them, lest they multiply, and it will be when we have a war and they will join to our enemies and they will fight us and drive us up from the land). Why is that the passuk used to prove that they did bad to us? Wouldn't a passuk related to the evil decrees they actually made or related to the terrible things they did to us be a better passuk to quote?