You do not need a Rabbi to effect a valid and binding Jewish marriage. You can halachicly get married without a Rabbi. And without ever getting a civil marriage license.
In fact, it is even possible to be halachicly married based on “just a joke” scenario of pretending to get married — but doing it halachicly correctly.