After several weeks of doing nothing I continued digging. Actually it was a good thing that I had waited such a long time. The snow that had covered my ditch and then later melted had actually made the clay soft so now it was way easier to shovel it. Problem was that since it was easier to shovel the wall of the ditch was pretty unstabel. So this happened twice, imagine how much I did curse.
But, last Thursday I got to cover the wall with plastic and threw a load of shingle to cover the pipe. So at least now if I get yet another landslide the damage will not be that frustrating. Hoping to finish up everything later today.
