Let's talk about cars.
Oh wait, we already did - remember that time we met, a few weeks ago, over steak and drinks? That was a great stake. We talked about cars. In fact, you seemed to be quite the expert on cars. You were able to explain, in detail, all of what's right and wrong and exciting about the latest Formula 1 race. You knew by heart all of Lamborghini's models, including their price and availability, you even had thoughts of purchasing your own Ferrari 599 GTB Fiorano, and currently saving up for it (bet the steak dinner didn't help much.)
While explaining the faults of Toyota in a great, excited voice, you suddenly jumped from your chair and screamed into the air, waving your fists about: "Damn it all, I'm a magnificent expert on all things related to cars! I'm gonna be a car mechanic!"
So you were. You had an interview, the Boss Man was just as impressed as I with your knowledge, and you were hired. The first client came in. His clutch was broken. You inspected it, and didn't know what to do. As a matter of fact, you had absolutely no idea how to follow the advice the Boss Man gave you. You're fired.
But how could this be!? You know everything about cars! Except for...everything about cars. You can very well know your dream car has a V12 engine, but you don't know what that actually means.
So you're not a car mechanic, really - you're a car enthusiast. And until you learn how cars work, you will remain one.
Now let me ask you. How does $.fn.text work? And what about $.fn? What is that, really? How does $(something) return a gigantic thingy containing things, and what is this thingy exactly? Can you replicate their functionality, at least a bit, in theory even? Can you cope without jQuery?
Saying that "native js is hard" is just...false. First and foremost, because javascript as a language has nothing to do with the DOM, which is mainly what jQuery abstracts. Second because once you learn a bit about the DOM, you can already coarse through the most common cross-browser bugs. But just a little secret - everything is hard at first. Long division was a bitch in 5th grade.
As a second analogy for this answer: jQuery is to javascript-DOM (not javascript the language, just the DOM) like Array.prototype.forEach is to for. It works, for 99% of the cases. And it works well. But for that 1% which isn't covered, you need to know how to use the for loop, if only to be practical. This entire answer is based on the "purer" side of the question, and not even the technical side (the library's size, for example, and several other things as explained in Michael Dorrant's answer), because I love javascript, and when people seem to just throw it aside casually saying "pah, those silly javascriptians" and waving fancy white gloves, it gets down to morality.
If you can accept the fact that you'll always be a javascript enthusiast, then who am I to stop you? But if you want to be a javascript programmer, you first have to have the knowledge to at least choose between using jQuery (or any other library) and not using a library. Learn the DOM. Learn how to use it. Write your own small library or just some collection of helper functions. And if then, when you are knowledgeable in the DOM, you choose to use jQuery - godspeed. Laziness is awarded for those who worked hard.