All fish are local to somewhere.
Conversely. all fish are non-local to everywhere else.
Unless they want to have an aquarium representing some specific biotype, most fish-keepers wouldn't give a thought to mixing east Asia fish with South American fish with African fish with Australian fish. Compatible requirements for temperature, water parameters, light, space, structure. flow, etc .. and temperment of the various species ... are the main factors on what to mix in community tanks or not. Any native-to-the-USofA fish would be exactly the same.
My default recommendation of "what native fish to start with" would be: "Something you can go out and collect yourself", so something that's close by, colorful and/or has character would pop to the top of the list. You have to check the regs that apply to your state (and/or nearby states), but in most states a regular fishing license will let you can catch small (non-game) fish with a net, and keep them for personal use.(Caveat, read the regulations for allowable species and methods of capture.) A license, a net, a bucket, and some shoes that can get wet are all you need to get started. A cooler to bring 'em home in is also useful. Now that we're in the summertime, you do have to be careful about temperatures, fish in buckets etc can get hot or oxygen-deprived quite quickly.
Peterson's Field Guide to Freshwater Species (2nd) edition is available at most big bookstores in the nature section, and sometimes at the library. I bought recently bought 2 used copies (1st edition) at a Friends of Library operation for $2 each. Not only is this an excellent field guide, but with the maps you can use it to figure out what's near you. And some states or fish-fiends have web-sites that highlight small fish that could have aquarium potential. For example, our own Josh Blaylock has an excellent site Kentucky Creeks.
The reason I recommend local-to-you fish is that we tend to have a special interest and affinity in the fish when we catch them in some creek ourselves, as opposed to hunting them down in an expedition to the Local Fish Store.
Connecting with any local NANFAns is a good way to get hints and pointers on where to go, how to find any species you're interested in, etc. Going with other people on a field trip is good fun and a great way to get started.
HTH
/way_more_than_you_asked_for