If you keep the panel connected as shown in your diagram it will absorb some power when it is not getting sunlight.
Charging battery direct from solar panel.
The position of the sun in the sky can impact a panel s charging speed.
Then run wires from the battery to the charge connector making sure to match the positive and negative poles.
Divide the wattage of the solar panel by the voltage of the battery to get the number of amps your charge connector needs to handle.
Generally a fully discharged 12 volt 100ah battery needs 1200 watts of energy to be 100 recharged.
For example your solar panel delivers 18 volts dc and 5 8 amps to the charge controller and the wire length is 40 feet.
Charge 100ah battery standard size solar panel is 58 inches by 27 inches 2 solar panel for 150 watts 12 volt each for 5 sunshine light hour takes to recharge 100ah 12 volt battery.
To charge a battery with a solar panel connect a charge connector to the solar panel.
Voltage drop in a single panel system as you can see in the calculation the voltage drop is 4 09 which will reduce the overall power delivered to the charge controller.
If a battery is totally drained a solar panel can energize the cells within five to eight hours.
Add a blocking diode on the positive rail between the battery and the panel or as previously suggested and the best solution imho use a small solar charge controller.
The bulk phase will initiate when the battery reaches a low charge stage and that is usually when the charge is below 80.