"I didn't have the Malibu mansion, but I had a little portable sound system," the country star tells PEOPLE in this week's ...