Easy way to do this is to create a new collection called ALL and give the sortBy to the need one.
Another easy way to edit the Navigation catalog and remove product and replace it with link "/collections/all?sort_by=created-descending#MainContent"
Another way is to change the collection.default.sort_by from
First step open your shopify account go to Themes -> Customize -> edit code.
Change the collection.default.sort_by = 'created-descending'