No, not necessarily. It would all depend on other variables, such as air condition and resistance. Even with regular planes it is the same concept. Think about a Cessna (small 3-4 person plane) and a jet (which is bigger than a Cessna). Even if the Cessna is smaller than a jet, the jet is still faster because of the way it is built.