Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

The LocalVocalTranscription menu item does not show up! #171

Open
zenny opened this issue Oct 1, 2024 · 5 comments
Open

The LocalVocalTranscription menu item does not show up! #171

zenny opened this issue Oct 1, 2024 · 5 comments

Comments

@zenny
Copy link

zenny commented Oct 1, 2024

Hi @royshil :

I installed obs and backgroundremoval from flatpak hub because Debian12 is not supported by your binary .deb files. Yet none of the your remaining plugins are not realeased as flatpaks, so I compiled theme from the source as per the README file and put them into the ~/.var/app/com.obsproject.Studio/config/obs-studio/plugins directory as follows:

├── plugins
│   ├── bin
│   │   └── 64bit
│   │       ├── libcargs.so
│   │       ├── libespeak-ng.so
│   │       ├── libkaldi-decoder-core.so
│   │       ├── libkaldi-native-fbank-core.so
│   │       ├── libonnxruntime.so
│   │       ├── libonnxruntime.so.1.17.1
│   │       ├── libpiper_phonemize.so -> libpiper_phonemize.so.1
│   │       ├── libpiper_phonemize.so.1 -> libpiper_phonemize.so.1.2.0
│   │       ├── libpiper_phonemize.so.1.2.0
│   │       ├── libsherpa-onnx-c-api.so
│   │       ├── libsherpa-onnx-core.so
│   │       ├── libsherpa-onnx-fstfar.so
│   │       ├── libsherpa-onnx-fst.so
│   │       ├── libsherpa-onnx-kaldifst-core.so
│   │       ├── libsherpa-onnx-portaudio.so
│   │       ├── libssentencepiece_core.so
│   │       ├── libucd.so
│   │       ├── obs-localvocal
│   │       │   ├── libonnxruntime_providers_shared.so
│   │       │   └── libonnxruntime.so.1.17.1
│   │       ├── obs-localvocal.so
│   │       └── obs-squawk.so
│   └── data
│       ├── locale
│       │   ├── ar-SA.ini
│       │   ├── de-DE.ini
│       │   ├── en-US.ini
│       │   ├── es-ES.ini
│       │   ├── fr-FR.ini
│       │   ├── hi-IN.ini
│       │   ├── ja-JP.ini
│       │   ├── ko-KR.ini
│       │   ├── pl-PL.ini
│       │   ├── pt-BR.ini
│       │   ├── ru-RU.ini
│       │   └── zh-CN.ini
│       └── models
│           ├── ggml-model-whisper-tiny-en
│           │   └── ggml-model-whisper-tiny.en.bin
│           └── silero-vad
│               └── silero_vad.onnx

Nevertheless, your flatpakobs-backgroundremoval appears to installed into ``~/.var/app/com.obsproject.Studio/config/obs-studio/plugin_config`, though the directory is empty:

├── plugin_config
│   ├── obs-backgroundremoval
│   ├── obs-browser
│   │   ├── 000003.log
│   │   ├── blob_storage
│   │   │   └── 9cb74ab8-104c-46f9-a95a-c30ae75eeb43
│   │   ├── Cache
│   │   │   └── Cache_Data
│   │   │       ├── 3d3f7d6cd3d2f23c_0
│   │   │       ├── 4a3b965998e0e4a3_0
│   │   │       ├── 8ee9ef815cd5ae02_0
│   │   │       ├── b1cf41be8e83bff6_0
│   │   │       ├── ce5721946e008b04_0
│   │   │       ├── e1bbdcc39d4fb416_0
│   │   │       ├── index
│   │   │       └── index-dir
│   │   │           └── the-real-index
│   │   ├── Code Cache
│   │   │   ├── js
│   │   │   │   ├── bd087925b8387ecf_0
│   │   │   │   ├── e5d931451313e22f_0
│   │   │   │   ├── fa3b549b5c064ff1_0
│   │   │   │   ├── index
│   │   │   │   └── index-dir
│   │   │   │       └── the-real-index
│   │   │   └── wasm
│   │   │       ├── index
│   │   │       └── index-dir
│   │   │           └── the-real-index
...

But that does not make obs-localvocal and obs-squawk available when flatpak run com.obsproject.Studio!

Appreciate if you can throw some light on installing your remaining obs-plugins which are not released into the flathub. Thanks!

Cheers,
/zenny
@zenny
Copy link
Author

zenny commented Oct 4, 2024 •
edited
Loading

Hi @royshil again,

I copied the compiled libraries of both localvocal and squawk into the specified directories in the obs debian package (not flatpak), yet that do not show up the menu as shown in your video demo. The tree looks like:

]$ tree ~/.config/obs-studio/plugins
/home/zenny/.config/obs-studio/plugins
├── bin
│   └── 64bit
│       ├── libcargs.so
│       ├── libespeak-ng.so
│       ├── libkaldi-decoder-core.so
│       ├── libkaldi-native-fbank-core.so
│       ├── libonnxruntime.so
│       ├── libonnxruntime.so.1.17.1
│       ├── libpiper_phonemize.so -> libpiper_phonemize.so.1
│       ├── libpiper_phonemize.so.1 -> libpiper_phonemize.so.1.2.0
│       ├── libpiper_phonemize.so.1.2.0
│       ├── libsherpa-onnx-c-api.so
│       ├── libsherpa-onnx-core.so
│       ├── libsherpa-onnx-fstfar.so
│       ├── libsherpa-onnx-fst.so
│       ├── libsherpa-onnx-kaldifst-core.so
│       ├── libsherpa-onnx-portaudio.so
│       ├── libssentencepiece_core.so
│       ├── libucd.so
│       ├── obs-localvocal
│       │   ├── libonnxruntime_providers_shared.so
│       │   └── libonnxruntime.so.1.17.1
│       ├── obs-localvocal.so
│       └── obs-squawk.so
└── data
    ├── locale
    │   ├── ar-SA.ini
    │   ├── de-DE.ini
    │   ├── en-US.ini
    │   ├── es-ES.ini
    │   ├── fr-FR.ini
    │   ├── hi-IN.ini
    │   ├── ja-JP.ini
    │   ├── ko-KR.ini
    │   ├── pl-PL.ini
    │   ├── pt-BR.ini
        ├── ggml-model-whisper-tiny-en
        │   └── ggml-model-whisper-tiny.en.bin
        └── silero-vad
            └── silero_vad.onnx

9 directories, 35 files

I also copied them to /usr/share and /usr/lib directories, yet no go!

sudo cp -R ./output_dir/lib/* /usr/lib/
sudo cp -R ./output_dir/share/* /usr/share

No matter what I do, the LocalVocalTranscription under Audio filters! Did I do something wrong?

Cheers and have a nice weekend,

/zenny

@zenny zenny changed the title The location to install in flatpack obs+backgroundremoval? The LocalVocalTranscription menu does not show up! Oct 4, 2024
@zenny zenny changed the title The LocalVocalTranscription menu does not show up! The LocalVocalTranscription menu item does not show up! Oct 4, 2024
@royshil
Copy link
Collaborator

royshil commented Oct 10, 2024

@zenny can you share the OBS logs please?

@zenny
Copy link
Author

zenny commented Oct 21, 2024

@zenny can you share the OBS logs please?

14:08:42.917: Using EGL/X11
14:08:42.917: CPU Name: Intel(R) Core(TM) i7-2600 CPU @ 3.40GHz
14:08:42.917: CPU Speed: 3519.148MHz
14:08:42.918: Physical Cores: 4, Logical Cores: 8
14:08:42.918: Physical Memory: 32047MB Total, 17361MB Free
14:08:42.918: Kernel Version: Linux 6.1.106_1
14:08:42.918: Distribution: "Void" Unknown
14:08:42.918: Desktop Environment: herbstluftwm
14:08:42.918: Session Type: x11
14:08:42.918: Window System: X11.0, Vendor: The X.Org Foundation, Version: 1.21.1
14:08:42.942: Qt Version: 6.7.2 (runtime), 6.7.2 (compiled)
14:08:42.942: Portable mode: false
14:08:43.325: OBS 30.2.3 (linux)
14:08:43.325: ---------------------------------
14:08:43.325: ---------------------------------
14:08:43.326: audio settings reset:
14:08:43.326: 	samples per sec: 48000
14:08:43.326: 	speakers:        2
14:08:43.326: 	max buffering:   960 milliseconds
14:08:43.326: 	buffering type:  dynamically increasing
14:08:43.367: ---------------------------------
14:08:43.367: Initializing OpenGL...
14:08:43.531: Loading up OpenGL on adapter NVIDIA Corporation Quadro K2000/PCIe/SSE2
14:08:43.531: OpenGL loaded successfully, version 3.3.0 NVIDIA 470.239.06, shading language 3.30 NVIDIA via Cg compiler
14:08:43.759: ---------------------------------
14:08:43.759: video settings reset:
14:08:43.759: 	base resolution:   3840x2160
14:08:43.759: 	output resolution: 3840x2160
14:08:43.759: 	downscale filter:  Bicubic
14:08:43.759: 	fps:               30/1
14:08:43.759: 	format:            NV12
14:08:43.759: 	YUV mode:          Rec. 709/Partial
14:08:43.759: NV12 texture support enabled
14:08:43.759: P010 texture support not available
14:08:43.783: Audio monitoring device:
14:08:43.783: 	name: Default
14:08:43.783: 	id: default
14:08:43.783: ---------------------------------
14:08:43.904: Failed to load 'en-US' text for module: 'decklink-captions.so'
14:08:43.951: Failed to load 'en-US' text for module: 'decklink-output-ui.so'
14:08:43.998: A DeckLink iterator could not be created.  The DeckLink drivers may not be installed
14:08:43.998: Failed to initialize module 'decklink.so'
14:08:44.021: Failed to load 'en-US' text for module: 'droidcam-obs.so'
14:08:44.660: [pipewire] No capture sources available
14:08:45.478: [obs-backgroundremoval] Plugin loaded successfully (version 1.2.0)
14:08:45.809: NVENC supported
14:08:45.851: VAAPI: API version 1.22
14:08:45.852: VAAPI: Failed to initialize display in vaapi_device_h264_supported
14:08:45.852: FFmpeg VAAPI H264 encoding not supported
14:08:45.869: VAAPI: Failed to initialize display in vaapi_device_av1_supported
14:08:45.870: FFmpeg VAAPI AV1 encoding not supported
14:08:45.886: VAAPI: Failed to initialize display in vaapi_device_hevc_supported
14:08:45.886: FFmpeg VAAPI HEVC encoding not supported
14:08:46.573: [vlc-video]: VLC 3.0.21 Vetinari found, VLC video source enabled
14:08:46.613: ---------------------------------
14:08:46.613:   Loaded Modules:
14:08:46.613:     vlc-video.so
14:08:46.613:     text-freetype2.so
14:08:46.614:     rtmp-services.so
14:08:46.614:     obs-x264.so
14:08:46.614:     obs-webrtc.so
14:08:46.614:     obs-transitions.so
14:08:46.614:     obs-outputs.so
14:08:46.614:     obs-filters.so
14:08:46.614:     obs-ffmpeg.so
14:08:46.614:     obs-backgroundremoval.so
14:08:46.614:     linux-v4l2.so
14:08:46.614:     linux-pulseaudio.so
14:08:46.614:     linux-pipewire.so
14:08:46.614:     linux-jack.so
14:08:46.614:     linux-capture.so
14:08:46.614:     linux-alsa.so
14:08:46.614:     image-source.so
14:08:46.614:     frontend-tools.so
14:08:46.614:     droidcam-obs.so
14:08:46.614:     decklink-output-ui.so
14:08:46.614:     decklink-captions.so
14:08:46.614:     command-source.so
14:08:46.614: ---------------------------------
14:08:46.642: ---------------------------------
14:08:46.642: Available Encoders:
14:08:46.642:   Video Encoders:
14:08:46.642: 	- ffmpeg_svt_av1 (SVT-AV1)
14:08:46.642: 	- ffmpeg_aom_av1 (AOM AV1)
14:08:46.642: 	- ffmpeg_nvenc (NVIDIA NVENC H.264 (FFmpeg))
14:08:46.642: 	- ffmpeg_hevc_nvenc (NVIDIA NVENC HEVC (FFmpeg))
14:08:46.642: 	- obs_x264 (x264)
14:08:46.642:   Audio Encoders:
14:08:46.642: 	- ffmpeg_aac (FFmpeg AAC)
14:08:46.642: 	- ffmpeg_opus (FFmpeg Opus)
14:08:46.642: 	- ffmpeg_pcm_s16le (FFmpeg PCM (16-bit))
14:08:46.642: 	- ffmpeg_pcm_s24le (FFmpeg PCM (24-bit))
14:08:46.642: 	- ffmpeg_pcm_f32le (FFmpeg PCM (32-bit float))
14:08:46.642: 	- ffmpeg_alac (FFmpeg ALAC (24-bit))
14:08:46.642: 	- ffmpeg_flac (FFmpeg FLAC (16-bit))
14:08:46.642: ==== Startup complete ===============================================
14:08:46.804: All scene data cleared
14:08:46.804: ------------------------------------------------
14:08:47.107: [obs-scripting]: Loaded lua script: UPDeck_2-1-19.lua
14:08:47.108: [Lua: UPDeck_2-1-19.lua] listening(id=1) interval=5...
14:08:47.133: [rtmp-services plugin] Successfully updated file 'services.json' (version 264)
14:08:47.134: [rtmp-services plugin] Successfully updated package (version 264)
14:08:47.272: [Python] Python failure in load_python_script:195:
14:08:47.275: [Python: zoom_and_follow_mouse.py] Traceback (most recent call last):
14:08:47.276: [Python: zoom_and_follow_mouse.py]   File "/home/zenny/Downloads/obs-tutorials/obs-zoom-and-follow/zoom_and_follow_mouse.py", line 2, in <module>
14:08:47.288: [Python: zoom_and_follow_mouse.py]     import pywinctl as pwc # version >=0.0.30
14:08:47.289: [Python: zoom_and_follow_mouse.py]     ^^^^^^^^^^^^^^^^^^^^^^
14:08:47.290: [Python: zoom_and_follow_mouse.py] ModuleNotFoundError: No module named 'pywinctl'
14:08:47.292: pulse-input: Server name: 'pulseaudio 16.1'
14:08:47.293: pulse-input: Audio format: s16le, 48000 Hz, 2 channels
14:08:47.293: pulse-input: Started recording from 'alsa_output.pci-0000_01_00.1.hdmi-stereo.monitor' (default)
14:08:47.293: [Loaded global audio device]: 'Desktop Audio'
14:08:47.293: v4l2-input: Start capture from /dev/video1
14:08:47.293: v4l2-input: Unable to open device
14:08:47.293: v4l2-input: Initialization failed, errno: No such file or directory
14:08:47.295: Switched to scene 'squawk-scene'
14:08:47.295: ------------------------------------------------
14:08:47.295: Loaded scenes:
14:08:47.295: - scene 'squawk-scene':
14:08:47.295:     - source: 'squawk' (v4l2_input)
14:08:47.295: ------------------------------------------------
14:09:34.253: pulse-input: Server name: 'pulseaudio 16.1'
14:09:34.254: pulse-input: Audio format: s16le, 48000 Hz, 2 channels
14:09:34.254: pulse-input: Started recording from 'alsa_output.pci-0000_01_00.1.hdmi-stereo.monitor' (default)
14:09:34.259: User added source 'Audio Input Capture (PulseAudio)' (pulse_input_capture) to scene 'squawk-scene'
14:10:04.477: User Removed source 'Audio Input Capture (PulseAudio)' (pulse_input_capture) from scene 'squawk-scene'
14:10:04.477: pulse-input: Stopped recording from 'alsa_output.pci-0000_01_00.1.hdmi-stereo.monitor'
14:10:04.477: pulse-input: Got 6284 packets with 1449905 frames

@zenny
Copy link
Author

zenny commented Nov 9, 2024

@royshil Is there something that I did go wrong based on the log above? I have also tried the same in the MXlinux (a debian-derivative based in bullseye), also did not show up the menu.

Thanking you in anticipation, and have a nice weekend,
/cheers

@royshil
Copy link
Collaborator

royshil commented Nov 25, 2024

@zenny just looking at the logs it seems it never attempted to load the obs-localvocal.so plugin file
so it must be the location where you installed it
depending on how you install OBS it will either look in ~/.config or /usr/local/lib for finding the plugins

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@royshil @zenny