LocalExtensionStorage removeExtension doesn't remove extension folder even if empty

After uninstalling an extension using extension manager and using Extension Tweak (that actually trigger a call to org.xwiki.extension.repository.internal.local.LocalExtensionStorage#removeExtension) to remove it from local storage the folder that has been created to store the extension version will remains even if being empty.
The same apply for the folder that store sub-folder for each version: even if empty folder will not be removed.