Advanced Installerというツールを使用してこれを行うことができます。手順
1. Create a new Installer Project Professional.
2. Select the files and folder option under Resources on the left side menu panel.
3. Right click on Application Folder > Add Files. Add your certificate and appx file.
4. Scroll down to Custom Actions tab under Custom Behavior on the left side menu panel.
5. Under Custom Actions, add a powershell inline script.
6. Write commands for installing the certificate and the extension. In parameter, pass
the certificate and appx file added to resources. Powershell commands-
certutil -addstore "TrustedPublisher" "<path>\certificate.cer"
Add-AppxPackage <path_to_appx_package>\uwpapp.appx
7. Under Execution time select- "When the system is being modified"
8. Under Execution options, select- Run with Local System with full previleges.
9. Select Builds tab in Package Definition,
10. Under configuration, package type, select Single Exe Setup(With Resources).
11. Right click on DefaultBuild and select build.This will generate an EXE file.