First thing I'd do is give the turbo a spin with a clean finger and feel it - it shouldn't have a gritty/rough feel to rotate it and it shouldn't wobble. If it is, before starting the engine again - look at the intake hose connecting to the intake manifold. What you're examining the inside for is powdered metal, a sign that the compressor wheel is rubbing on something.
I wouldn't drill the bolts for a couple of reasons. First, the bolt needs a certain degree of strength because it's withstanding the impact of hot oil under a fair amount of pressure connected to a very, very hot turbocharger.
Second, as Tappet points out, the oil is metered through that aperture so that enough oil reaches the turbocharger bearings and the remaining oil pressure can make it up to the camshaft bearings, mains, water pump etc. If you give more to one, you take from another - and under heavy strain that could become very costly.
Looking after your turbocharger is very simple - let it cool before the oil flow stops. This means - again as Tappet points out - idling the engine for a couple of minutes after a hard workout, or just driving gently when you're a couple of minutes away from your destination. As Chule suggests, a turbo timer is also a handy and inexpensive investment.
If you're still concerned, the best investment you could make is an intercooler. If the turbocharger does let go, the intercooler will catch pretty much all of the little bits, saving your engine. It will also give your engine a degree of improvement in efficiency, as the intercooler takes the 200C+ compressed air from the turbocharger and cools it to about 50C just before the intake manifold. This considerably raises the number of air molecules per cylinder, allowing the diesel to burn more completely, providing more power (it's not a huge amount, but it will be there).