Taxes
For taxes, I won't bother with crazy optimization.
I'll just pay my crazy french tax and that's it.
For project with my coworker and I, I'll bill through the USA company, and for projects where only me is working, I'll use my French company.
One thing also is that to last long, you need family and friends.
Those live in France, and they're taken care of by the government.
... that's one way of rationalizing it.