I am trying to understand why I cannot query the 'Notes' object directly, but can only use it via the Account relationship.

Below query does not work.
select CreatedBy.Name from Notes.

But this query works
select Name, (select CreatedBy.Name from Notes) from Account