Wow such great advice from everyone! Thanks a bunch! You all have given me some things to think about. If I try this idea I have, it will definitely be "on the side" at first and it does involve more consulting than actual labor/materials to keep track of.
It's a big leap. I appreciate everyone's perspective.