I spent years with the same workflow, and Evernote groaned to a halt with over 5000 PDFs in it for me. (i7, 16gb ram).

I now store all my scans in Google Drive and use the OCR that comes with the ScanSnap. It works just as well, the search is Google fast and I can share them easily.