A cheap trick for those small fragile drill bits is to use a small finish nail or any other small nail and to cut the hammer head off with pliers, these obviously won't work in metal though.