But doesn't Catalog() return all objects in the Catalog? Doesn't all the meta-data for those objects have to be loaded into memory ratehr than just the 50 that are actually needed?

No, it returns a list-like object that load objects into memory only as the elements of that sequence are accessed. Objects are arranged in the right order within that sequence using the metadata cached by the catalog.