Is milk matter?

Yes it has mass and occupies space. It is a liquid-state heterogeneous mixture (colloid), not a state of matter itself.