Update:
I've replaced the bearing (it was on it's way out) and the seal.
To be sure, I've used a tiny bit of RTV between the flywheel and the crankshaft.
The engine has done about 200km now and still no signs of oil leaking, so I think the problem is solved.