Problem:

With MS Project connected to TFS Project takes forever to refresh.

Solution:

One possible solution is to change the calculation mode from automatic to manual.  To change the calculation mode select Tools / Options / Calculation / Calculation Mode and change from automatic to manual.