Yes as r increases, F decrerases
But when considerring escape velocity, we are looking at Gravitational potential energy.
GPE = -GMm/r
\Delta GPE = GMm/r
By equating change in GPE and Kinetic Energy, we are able to determine the escape velocity
\Delta GPE = Kinetic Energy
GMm/r = 1/2 mv^2...