If you can turn off the device (or pull the battery), and have a somewhat fast internet connection, you can download this file 10.1.0.4543
once it has been downloaded, you can unzip it (using some type of archiving software (WINrar, 7zip, etc), you can then load this OS onto your device)
Once the file has been extracted, and with your device off, you can double click the install file and then connect your device to your computer (with the device still off or the battery out)
Once you have clicked on the install file, you should see a window open up with the phrase "Connecting to Bootrom", then you can place the battery in your device or turn it on. It should load the OS very quickly (5 - 10 minutes), your device will reboot and you should be presented with the initial setup again. That may fix your device trying to download some update (I am not sure which screen your device is stuck at, but if the above doesn't work, I would ring Orange and either exchange the device (last resort?) or if you are able, bring it into an Orange retailer.
Bootrom loader screen should look like this...