You don't download your Xbox profile—you sync it. When you sign in on a new console, your achievements, friends list, saves, and settings pull down from Microsoft's cloud servers. Your profile lives online, not on any single hard drive.
Your profile is safe in the cloud. The "download" is just a sync—and it's one of Xbox's best features.