Most of the work for this came from this unity thread. I cleaned it up a bit and will probably tweak it a bit for my needs but wanted a safe place for it to live besides a forum post.
https://forum.unity3d.com/threads/swipe-in-all-directions-touch-and-mouse.165416/
drop the inputcontroller on something, good to go