Forcefields on miller village

How do i get past the forcefields on miller village? I dont see any way to get by those.

There;s a lever in Castle Oborot. There;s a hole in the far northeast that you reach by tapping a black wall. That hole drops you down to where the lever is.