But in one case colour is perceived and in the other case the push due to the object.

If you snip certain nerves, there is an end to the perception of colour; and if you snip certain other nerves, there is an end to the perception of push.

It would appear therefore that any reasons which should remove colour from the reality of nature should also operate to remove inertia.
Thus the attempted bifurcation of apparent nature into two parts of which one part is both causal for its own appearance and for the appearance of the other part, which is purely apparent, fails owing to the failure to establish any fundamental distinction between our ways of knowing about the two parts of nature as thus partitioned.

I am not denying that the feeling of muscular effort historically led to the formulation of the concept of force.

But this historical fact does not warrant us in assigning a superior reality in nature to material inertia over colour or sound.