What you are talking about happens only with a violation of private property. We live in a mixed economy, where property rights are upheld in general, but violated fairly often.
Bankers especially do not operate in a free market. They are regulated by a central bank which tries to control interest rates and the supply of money for a whole bunch of purposes. Our banking system also functions on fractional reserve, which is a violation of the original legal principle of deposit. Demand deposits, like checking accounts, are supposed to be available for withdrawal at any time. But banks only keep a small reserve to serve the needs of those people who want to withdraw their money.
Money, Bank Credit, and Economic Cycles by Jesus Huerta de Soto
Whereas loan contracts (commodatum and mutuum) entail the transfer of the availability of the good, which shifts from the lender to the borrower for the duration of the term, another type of contract, the deposit contract, requires that the availability of the good not be transferred. Indeed, the contract of
deposit (depositum in Latin) is a contract made in good faith by which one person—the depositor—entrusts to another—the depositary—a movable good for that person to guard, protect, and return at any moment the depositor should ask for it. Consequently, the deposit is always carried out in the interest
of the depositor. Its fundamental purpose is the custody or safekeeping of the good and it implies, for the duration of the contract, that the complete availability of the good remain in favor of the depositor, who may request its return at any moment. The obligation of the depositor, apart from delivering the good, is to compensate the depositary for the costs of the deposit (if such compensation has been agreed upon; if not, the deposit is free of charge). The obligation of the depositary is to guard and protect the good with the extreme diligence typical of a good parent, and to return it immediately to the depositor as soon as he asks for it. It is clear that, while each loan has a term of duration during which the availability of
the good is transferred, in the case of a deposit this is not so. Rather a deposit is always held and available to the depositor, and it terminates as soon as he demands the return of the good
from the depositary.
So when banks lend your deposited money, it is a kind of fraud, a violation of your property rights.