Hi from PA! Soap making doesn't have to be expensive. My favorite recipe is 55% lard, 15% coconut, 15% olive, 10% avocado and 5% castor. The olive and/or avocado can be replaced with rice bran if you can find that cheaper.
Lard is by far the cheapest oil for me. You may be able to find a farmer local to you in the spring that slaughters pigs and trade some milk for fat.
My suggestions: Don't go buying a bunch of stuff until you decide for sure if it's for you. Pringles cans, milk cartons, yogurt cups and cereal boxes make good molds. Buying smaller amounts of oils locally is better than ordering and paying shipping until you decide on a recipe that you like. Don't worry about the pretty colors right away. If you insist on scents right away, Nature's Garden is a popular supplier. They are reasonably priced and they are in Ohio, so if not close enough for a quick visit, shipping isn't bad. The only things you really must have are #2 or 5 recycling code containers, silicone spatula and stick blender, all dedicated specifically to soap and oils and lye. Take meticulous notes, they come in handy later. Lastly, have fun!!