Vinyl LP's are a passion and an investment. Don't play them on a poorly constructed machine that is designed to destroy the grooves in a few plays.
There are cheap players that look cool, retro and affordable, but in the end they will
cost you more with the destruction of your collection.
Here are some links to affordable options and some more expensive options, but nothing that will break the bank. The most important thing in buying a turntable is to get one with fixed or adjustable counter weight and fixed or adjustable anti skating. The counter weight will keep the stylus from grinding the grooves away and the anti skating will keep the stylus from tearing through the grooves as the record is played. Protect your investment in vinyl for years to come with a proper turntable. The other components can wait.
This combination is just around $200 for a fine player and descent speakers. You can use the turntable with an existing receiver, amplifier, "Boombox" style speaker or most any audio source with a input for just around $99 - AT LP60 only.
Audio Technica LP60X
Edifer Powered Speakers
This combination is a bit pricer, but will allow for future upgrades as you grow and learn more about the vinyl world. This will be in the $800 range for a fantastic, flexible, lovely sounding system. Again, you can use the AT LP120 with any existing audio source with an input and purchase the rest later.
 
Audio Technica LP3
Audio Technica LP120
Yamaha R-N303 Network Stereo Receiver
Q Acoustics 3020 Bookshelf Speakers
Here are other turntables, powered speakers and amplifiers to consider. You can use the Fluance or Monolith turntables with any existing audio source with an input and purchase other components later.
Fluance Turntables
Audio Engine 5+ Powered Speakers
Yamaha A-S301 Stereo Amplifier
Monolith Turntable by Monoprice
Don't fear pre-owned equipment on eBay or other online sellers.  Just ask questions, check return policies and enjoy some great vintage equipment.
If you have questions, or you want to have a chat about something related, get in touch with us, or stop in to see us.