Weird OpenGL Behaviour

Questions about applications and software
Forum rules
Before you post read how to get help. Topics in this forum are automatically closed 6 months after creation.
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Weird OpenGL Behaviour

Post by Nervous_Testpilot »

Hi everyone :)

So i have this really weird problem with OpenGL applications, probably all of them. So far i tested: glxgears (started via terminal), devildaggers, quakespasm. The most obvious one would be Devil Daggers. I notice very strong stuttering, despite the framerate being very high. Be it if the screen is busy or merely empty, it just seems to happen at random points, but gets worse the longer the program runs. That wouldn't be surprising to me if the framerate would dip, which it doesn't, it stays at a rock solid 120 FPS, with maybe 1-2 frames dropping here and there. BUT after a few minutes, as i said the graphics begin to "stutter". It looks like the game dropped down to 20 FPS, it's a slideshow almost, BUT the framerate stays consistent at 120 FPS, i could push it even higher, way
above 1000 FPS, which I wouldn't do of course, because that would stress the GPU unnecessarily. Now i've played this
game for many hours on my old machine, which had the same Nvidia provided graphics driver (version 515) and it also ran via steam proton (ge-proton to be exact) or Steam Linux runtime, with no issues at all. Which doesn't make sense, since this system is way less powerfull then my current rig and the game isn't demanding at all.

I did a quick install of quakespasm, because as i understand, this sourceport also uses OpenGL. I noticed very slight stuttering here and there but nothing serious.

glxgears shows stuttering at seemingly random points, with or without Vsync. Yet there are also no drops in framerate.

So far Vulkan applications work fine and games using DXVK as well.

I suspect that somethings up with frame-timing when using OpenGL or my system is broken somewhere deep down, which would be a nice thing to fix.
This would surprise me because this is vanilla and fresh install of Linux Mint 21.1. I checked both hashes of the ISO and the installation-medium, they are both correct. Not that i think it's impossible, but all the more a reason to get to the bottom of this.
Anyway, as i describe below i have sadly no way of confirming this, because everything i try to do exactly that fails.

Further below i have also listed my specs and what i've tried so far to mitigate the problem.

Also worth mentioning, my old machine runs Linux Mint 21, with NVIDIA Drivers 515, has i7 6700k Processor, paired with a Nvidia GTX980ti. This rig runs everything absolutely perfectly. So maybe something has fundamentally changed between version 21 and 21.1 regarding OpenGL?

The PC that has this problem, currently runs Mint 21.1 and is primarily built for calculating fractals, rendering and handling very big eurorack synthesizer setups. Gaming is not it's primary focus, but as i said i'm a bit worried on how reliable this installation will be, if it already fails with a "simple" OpenGL app. So i want to go to the bottom of this problem, so that it doesn't bite me in the bum later.

Regarding the frame-timing, i have no way of confirming this since MangoHUD refuses to work with Devil Daggers, no matter the version (Linux native, proton, etc...), or what variables i feed to MangoHUD. According to pcgamingwiki this game uses opengl 3.3, which should work with mangohud (i checked the man page and followed it's instructions --> game crashes), and again this game has linux a native version, so it's a bit of a head-scratcher for why exactly this game behaves so weirdly. MangoHUD works fine with vulkan applications but OpenGL? Not so much. I dug for days through forums and wikis, to find the right variables. None of them work.

So it would be really helpful for me if:

1. Someone could give his or hers opinion what the culprit of my problem could be and maybe how to mitigate it and
2. If someone knows a alternative to MangoHUD, that is able to work alongside Steam, and also monitor frame-timing, so i can validate or dismiss frame-timing
theory at least.

I also dug through some threads on the Nvidia Forums, regarding OpenGL and the Nvidia Drivers. I have found nothing conclusive, but it seems like the more time goes on, more and more people seem to have trouble with OpenGL applications. Some people had to reseat their graphics card into a other pci slots, use different HDMI ports, swap drivers around etc..., and their problems would vanish. I tried that also, with no results.

So here is what i have done so far:

- Swapped out Nvidia driver 525 for 515 ---> no difference at all

- Checked cabling of the whole computer, re-seat RAM and GPU ---> Nothing unusual, no difference afterwards

- Deleted the shader cache in ~/.steam/steam/steamapps/shadercache ---> no difference at all

- Changed CPU Power profile from Schedutil to Performance and to various fixed frequencies ---> also no difference

- Fixed the CPU-Core affinity of the process (Devil Daggers) to a single thread with taskset -cp ---> no change at all

- Fixed the CPU-Core affinity of the process (Devil Daggers) to 4 threads with taskset -cp ---> no change at all

- Changed the GPU's power profile from "auto" to "performance" ---> no change

- Tried out different versions: Steam proton 4,5,6,7, Proton Glorious Eggroll, Steam Linux Runtime ---> every version has the same problem

- Checked the display refresh rate in system settings ---> it is correct

- Enabled in-game VSync ---> horribly laggy

- Disabled VSync (VBlank) on Nvidia driver and made sure via the frame counter from nvidia, that he reports that, vsync is indeed turned off ---> it was turned
off,but again this made no difference at all

- Disabled flipping in the driver settings ---> also no difference

- Disabled conformant texture clamping ---> no change

- Tried out different image quality settings ---> made no difference

- Changed from fullscreen to windowed ---> no change

- Remove and purge Steam and also removed the .steam folder in the home directory, then remove and purge nvidia drivers, followed by apt autoremove, rebooted
the system, then reinstalled everything via terminal, no issues while installing, reboot again ---> same problem as before

- Swapped out mouse (since the mouse would "jitter" sometimes, in and outside games), monitor cables, tried different ports ---> no change at all

- Kept an eye on CPU and GPU Temperatures at all times ---> everything normal also no weird heat spikes

- Tested other games which put way more pressure on the system ---> aside from OpenGL, the problem is not present so far

- Run glxgears to see if the problem also shows up here ---> It does. The gears turn fine for a moment, then they start to "hitch"/"stutter"

Here are the specs (tell me if you need more infos):

System:

Kernel: 5.15.0-58-generic x86_64 bits: 64 compiler: gcc v: 11.3.0 Desktop: MATE 1.26.0 wm: marco
dm: LightDM Distro: Linux Mint 21.1 Vera base: Ubuntu 22.04 jammy

Graphics:

Device-1: NVIDIA TU106 [GeForce RTX 2060 SUPER] vendor: ZOTAC driver: nvidia v: 525.78.01 pcie:
speed: 2.5 GT/s lanes: 16 ports: active: none off: HDMI-A-1 empty: DP-1,DP-2,DP-3
bus-ID: 4c:00.0 chip-ID: 10de:1f06
Display: x11 server: X.Org v: 1.21.1.3 compositor: marco v: 1.26.0 driver: X: loaded: nvidia
unloaded: fbdev,modesetting,nouveau,vesa gpu: nvidia display-ID: :0 screens: 1
Screen-1: 0 s-res: 1920x1080 s-dpi: 96
Monitor-1: HDMI-0 res: 1920x1080 dpi: 92 diag: 609mm (24")
OpenGL: renderer: NVIDIA GeForce RTX 2060 SUPER/PCIe/SSE2 v: 4.6.0 NVIDIA 525.78.01
direct render: Yes

I'm looking forward to your answers, opinions, suggestions and wish you all a very nice day :D
Last edited by LockBot on Tue Jul 25, 2023 10:00 pm, edited 1 time in total.
Reason: Topic automatically closed 6 months after creation. New replies are no longer allowed.
User avatar
MikeNovember
Level 7
Level 7
Posts: 1856
Joined: Fri Feb 28, 2020 7:37 am
Location: Nice, Paris, France

Re: Weird OpenGL Behaviour

Post by MikeNovember »

Hi,

As per Nvidia website, https://www.nvidia.fr/Download/driverRe ... 8554/en-us, you should use 525.85.05 driver.

It seems it is not yet available in PPA Graphics drivers for Ubuntu 22.04 / Linux Mint 21.x (it has been released by Nvidia on 2023.1.19).

Install PPA Graphics drivers https://launchpad.net/~graphics-drivers ... ubuntu/ppa and update your driver as soon as 525.85.05 is available, it might solve your problem.

Regards,

MN
_____________________________
Linux Mint 21.3 Mate host with Ubuntu Pro enabled, VMware Workstation Player with Windows 10 Pro guest, ASUS G74SX (i7-2670QM, 16 GB RAM, GTX560M with 3GB RAM, 1TB SSD).
User avatar
SMG
Level 25
Level 25
Posts: 31914
Joined: Sun Jul 26, 2020 6:15 pm
Location: USA

Re: Weird OpenGL Behaviour

Post by SMG »

Nervous_Testpilot wrote: Wed Jan 25, 2023 11:40 amSo maybe something has fundamentally changed between version 21 and 21.1 regarding OpenGL?
No. Both versions are based on Ubuntu 22.04. The OpenGL version you are using is based on your Nvidia driver. The data below indicates the version is v: 4.6.0.

Code: Select all

  OpenGL: renderer: NVIDIA GeForce RTX 2060 SUPER/PCIe/SSE2 v: 4.6.0 NVIDIA 525.78.01
    direct render: Yes
Nervous_Testpilot wrote: Wed Jan 25, 2023 11:40 amThe PC that has this problem, currently runs Mint 21.1 and is primarily built for calculating fractals, rendering and handling very big eurorack synthesizer setups.
Does this rig has CUDA or CUDA tools packages installed while the older rig does not?

I do not game so I can not help you with recommendations of what to install for comparisons.
Image
A woman typing on a laptop with LM20.3 Cinnamon.
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

SMG wrote: Wed Jan 25, 2023 9:39 pm
I do not game so I can not help you with recommendations of what to install for comparisons.

Does this rig has CUDA or CUDA tools packages installed while the older rig does not?

I do not game so I can not help you with recommendations of what to install for comparisons.
Thank you for your quick reply SMG

I checked both my old and new PC for anything CUDA releated.

Checking apt, it seems that none of the CUDA-Toolkits are installed.
I checked for:

Code: Select all

nvidia-cuda-toolkit-gcc
nvidia-cuda-toolkit-doc
nvidia-cuda-toolkit
nvidia-cuda-gdb
nvidia-cuda-dev
nvidia-cudnn
boinc-client-nvidia-cuda
nvidia-visual-profiler
nvidia-primus-vk-wrapper
nvidia-profiler
python-pycuda-doc
python3-pycuda
python3-pyhst2-cuda
relion-cuda
relion-gui-cuda
What i can find on both systems is the following:

Old PC:

Code: Select all

nvidia-compute-utils-515
nvidia-compute-515
nvidia-compute-515:i386
nvidia-decode-515
nvidia-decode-515:i386
New PC:

Code: Select all

nvidia-compute-utils-525
nvidia-compute-525
nvidia-compute-525:i386
nvidia-decode-525
nvidia-decode-525:i386
Also while digging through the file system (both of the old the new machine) i found nvidia-cuda-mps-control in /usr/bin/, it also has a man page but isn't listed as installed by apt. Probably part of the packages above, but it's hard for me to tell.

Judging from the description of the installed ones, i think these are libraries and utility-binaries, for the nvidia-driver to use CUDA, correct me if i'm wrong. So following this assumption, i assume the CUDA-Toolkits are not installed while regular CUDA is (?).
User avatar
Kris345
Level 5
Level 5
Posts: 546
Joined: Mon Jun 22, 2020 10:22 am
Location: New England

Re: Weird OpenGL Behaviour

Post by Kris345 »

I switched to "Nvidia on Demand" from "Nvidia Performance Mode" and it seems to have fixed mine.

(New 21.1 Mint Cin build. -- ThinkPad P15s-Gen1-20T4-002KUS, i7-10510U, UEFI/GPT, 16GB, Sammy 970 EVO Plus 500GB M.2.
-- ASUS Prime Z790-V WIFI, I9-12900k, UEFI/GPT, 32GB, Sam 980 Pro 1T M.2 .
-- ThinkPad P15s-Gen1-20T4-002KUS, i7-10510U, UEFI/GPT, 16GB, Sammy 970 EVO Plus 500GB M.2.
-laserjets: HP M254dw color, HP P1606dn. Epson Perfection 2480 flatbed scanner -
User avatar
SMG
Level 25
Level 25
Posts: 31914
Joined: Sun Jul 26, 2020 6:15 pm
Location: USA

Re: Weird OpenGL Behaviour

Post by SMG »

Nervous_Testpilot wrote: Thu Jan 26, 2023 2:37 pmAlso while digging through the file system (both of the old the new machine) i found nvidia-cuda-mps-control in /usr/bin/, it also has a man page but isn't listed as installed by apt. Probably part of the packages above, but it's hard for me to tell.
I am not aware of it being part of what listed as having. Perhaps at some time in the past you had it installed.
Nervous_Testpilot wrote: Thu Jan 26, 2023 2:37 pmJudging from the description of the installed ones, i think these are libraries and utility-binaries, for the nvidia-driver to use CUDA, correct me if i'm wrong. So following this assumption, i assume the CUDA-Toolkits are not installed while regular CUDA is (?).
Check the output of

Code: Select all

dpkg -l | grep -i nvidia
I seem to recall CUDA-related packages having the word CUDA either in the package name or the package description.
Image
A woman typing on a laptop with LM20.3 Cinnamon.
DisturbedDragon
Level 5
Level 5
Posts: 574
Joined: Mon Oct 29, 2012 6:29 pm
Location: Texas

Re: Weird OpenGL Behaviour

Post by DisturbedDragon »

Try to drop back to the previous driver. I just swapped out my RTX2080 and was using the 460 or 470 driver (don't quite remember) and the card blazed on it. Newer drivers caused similar issues. Using the current 525 repo driver now with my RTX4090 without issues but it definitely did not work well with the 20 series.
AMD Ryzen 9 5950X 16C/32T | MSI MPG x570 Gaming Plus | 2TB Mushkin Pilot-E NVMe | 1TB Crucial P1 NVMe | 2x 2TB Inland Gen4 NVMe | 32GB Trident Z DDR4 3600 | Nvidia RTX4090 | Fedora 39 Cinnamon | Linux Mint 21.3 Cinnamon | Kernel 5.15.x lowlatency
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

DisturbedDragon wrote: Fri Jan 27, 2023 11:04 pm Try to drop back to the previous driver. I just swapped out my RTX2080 and was using the 460 or 470 driver (don't quite remember) and the card blazed on it. Newer drivers caused similar issues. Using the current 525 repo driver now with my RTX4090 without issues but it definitely did not work well with the 20 series.
Thanks for the tip. I will try this as soon as get the time to do so :)
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

SMG wrote: Thu Jan 26, 2023 8:16 pm
Nervous_Testpilot wrote: Thu Jan 26, 2023 2:37 pmAlso while digging through the file system (both of the old the new machine) i found nvidia-cuda-mps-control in /usr/bin/, it also has a man page but isn't listed as installed by apt. Probably part of the packages above, but it's hard for me to tell.
I am not aware of it being part of what listed as having. Perhaps at some time in the past you had it installed.
Nervous_Testpilot wrote: Thu Jan 26, 2023 2:37 pmJudging from the description of the installed ones, i think these are libraries and utility-binaries, for the nvidia-driver to use CUDA, correct me if i'm wrong. So following this assumption, i assume the CUDA-Toolkits are not installed while regular CUDA is (?).
Check the output of

Code: Select all

dpkg -l | grep -i nvidia
I seem to recall CUDA-related packages having the word CUDA either in the package name or the package description.
Thanks a lot for you responses :D

Ok, so here is the output of

Code: Select all

dpkg -l | grep -i nvidia

Code: Select all

ii  libnvidia-cfg1-525:amd64                   525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA binary OpenGL/GLX configuration library
ii  libnvidia-common-525                       525.78.01-0ubuntu0.22.04.1                 all          Shared files used by the NVIDIA libraries
rc  libnvidia-compute-515:amd64                515.86.01-0ubuntu0.22.04.1                 amd64        NVIDIA libcompute package
ii  libnvidia-compute-525:amd64                525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA libcompute package
ii  libnvidia-compute-525:i386                 525.78.01-0ubuntu0.22.04.1                 i386         NVIDIA libcompute package
ii  libnvidia-decode-525:amd64                 525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA Video Decoding runtime libraries
ii  libnvidia-decode-525:i386                  525.78.01-0ubuntu0.22.04.1                 i386         NVIDIA Video Decoding runtime libraries
ii  libnvidia-egl-wayland1:amd64               1:1.1.9-1.1                                amd64        Wayland EGL External Platform library -- shared library
ii  libnvidia-encode-525:amd64                 525.78.01-0ubuntu0.22.04.1                 amd64        NVENC Video Encoding runtime library
ii  libnvidia-encode-525:i386                  525.78.01-0ubuntu0.22.04.1                 i386         NVENC Video Encoding runtime library
ii  libnvidia-extra-525:amd64                  525.78.01-0ubuntu0.22.04.1                 amd64        Extra libraries for the NVIDIA driver
ii  libnvidia-fbc1-525:amd64                   525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA OpenGL-based Framebuffer Capture runtime library
ii  libnvidia-fbc1-525:i386                    525.78.01-0ubuntu0.22.04.1                 i386         NVIDIA OpenGL-based Framebuffer Capture runtime library
ii  libnvidia-gl-525:amd64                     525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA OpenGL/GLX/EGL/GLES GLVND libraries and Vulkan ICD
ii  libnvidia-gl-525:i386                      525.78.01-0ubuntu0.22.04.1                 i386         NVIDIA OpenGL/GLX/EGL/GLES GLVND libraries and Vulkan ICD
rc  nvidia-compute-utils-515                   515.86.01-0ubuntu0.22.04.1                 amd64        NVIDIA compute utilities
ii  nvidia-compute-utils-525                   525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA compute utilities
rc  nvidia-dkms-515                            515.86.01-0ubuntu0.22.04.1                 amd64        NVIDIA DKMS package
ii  nvidia-dkms-525                            525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA DKMS package
ii  nvidia-driver-525                          525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA driver metapackage
rc  nvidia-kernel-common-515                   515.86.01-0ubuntu0.22.04.1                 amd64        Shared files used with the kernel module
ii  nvidia-kernel-common-525                   525.78.01-0ubuntu0.22.04.1                 amd64        Shared files used with the kernel module
ii  nvidia-kernel-source-525                   525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA kernel source package
ii  nvidia-prime                               0.8.17.1                                   all          Tools to enable NVIDIA's Prime
ii  nvidia-prime-applet                        1.3.5                                      all          An applet for NVIDIA Prime
ii  nvidia-settings                            510.47.03-0ubuntu1                         amd64        Tool for configuring the NVIDIA graphics driver
ii  nvidia-utils-525                           525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA driver support binaries
ii  screen-resolution-extra                    0.18.2                                     all          Extension for the nvidia-settings control panel
ii  xserver-xorg-video-nvidia-525              525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA binary Xorg driver
So, no mention of CUDA here, but when i lookup the packages i mentioned (in synaptic), in my earlier reply to you, from their decription, they all seem at least CUDA related. So for example libnvidia-compute-525 reads:

"This package provides a set of libraries which enable the NVIDIA driver
to use GPUs for parallel general purpose computation through CUDA and
OpenCL."

Regarding nvidia-cuda-mps-control, i did definitely not install anything manually when it comes to nvidia, or drivers in general. Also so far, i have not used any PPA's that are outside of what linux mint comes bundled with. So the only reason why it's there, that i can think of, is that it came automatically with the nvidia drivers itself, or maybe with razer genie since this package (flatpak) does a "upgrade" to the nvidia platform. It seems unlikely that this is the problem tough, because i did test my system before i even installed razer genie.

A question in general: Do you see a problem with CUDA being installed or the lack there of?
User avatar
SMG
Level 25
Level 25
Posts: 31914
Joined: Sun Jul 26, 2020 6:15 pm
Location: USA

Re: Weird OpenGL Behaviour

Post by SMG »

Nervous_Testpilot wrote: Sun Jan 29, 2023 7:49 amOk, so here is the output of

Code: Select all

dpkg -l | grep -i nvidia
Looks like you have a mix of Nvidia-515 and Nvidia-525 files. You could try running apt remove nvidia-driver-515 and then apt autoremove to see if you can clear them out, but sometimes they are stubborn and remain. If you used only Driver Manager to install drivers, then they are likely not causing a problem.
Nervous_Testpilot wrote: Sun Jan 29, 2023 7:49 amSo, no mention of CUDA here, but when i lookup the packages i mentioned (in synaptic), in my earlier reply to you, from their decription, they all seem at least CUDA related. So for example libnvidia-compute-525 reads:

"This package provides a set of libraries which enable the NVIDIA driver
to use GPUs for parallel general purpose computation through CUDA and
OpenCL."
It says CUDA and OpenCL which are two different things.
Nervous_Testpilot wrote: Sun Jan 29, 2023 7:49 amAlso so far, i have not used any PPA's that are outside of what linux mint comes bundled with.
Linux Mint does not come bundled with any PPAs. You have to manually add PPAs to your install to get PPAs.
Nervous_Testpilot wrote: Sun Jan 29, 2023 7:49 amA question in general: Do you see a problem with CUDA being installed or the lack there of?
No. If you do not have a need for it, there is no reason to install it.
Image
A woman typing on a laptop with LM20.3 Cinnamon.
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

Kris345 wrote: Thu Jan 26, 2023 7:47 pm I switched to "Nvidia on Demand" from "Nvidia Performance Mode" and it seems to have fixed mine.

(New 21.1 Mint Cin build. -- ThinkPad P15s-Gen1-20T4-002KUS, i7-10510U, UEFI/GPT, 16GB, Sammy 970 EVO Plus 500GB M.2.
Hmmm what exactly did it resolve for you?

"On Demand" is not available to me. Only "Auto" "Adaptive" "Prefer Maximum Performance". Maximum Performance made no difference and as i understand it, this mode should be the "snappiest" of them all right?
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

Nervous_Testpilot wrote: Sun Jan 29, 2023 7:24 am
DisturbedDragon wrote: Fri Jan 27, 2023 11:04 pm Try to drop back to the previous driver. I just swapped out my RTX2080 and was using the 460 or 470 driver (don't quite remember) and the card blazed on it. Newer drivers caused similar issues. Using the current 525 repo driver now with my RTX4090 without issues but it definitely did not work well with the 20 series.
Thanks for the tip. I will try this as soon as get the time to do so :)
Ok so i checked out version 470, which made no difference at all. 460 is not available to me, at least not by normal means. But thanks for your tip anyways :D
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

SMG wrote: Sun Jan 29, 2023 6:40 pm
Nervous_Testpilot wrote: Sun Jan 29, 2023 7:49 amOk, so here is the output of

Code: Select all

dpkg -l | grep -i nvidia
Looks like you have a mix of Nvidia-515 and Nvidia-525 files. You could try running apt remove nvidia-driver-515 and then apt autoremove to see if you can clear them out, but sometimes they are stubborn and remain. If you used only Driver Manager to install drivers, then they are likely not causing a problem.
To rule out a driver conflict i uninstalled every last remnant of what i could find from nvidia and reinstalled driver 525 again (using the driver manager), sadly the problem is still the same.
If i enter dpkg -l | grep -i "nvidia" i now get this:

Code: Select all

ii  libnvidia-cfg1-525:amd64                   525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA binary OpenGL/GLX configuration library
ii  libnvidia-common-525                       525.78.01-0ubuntu0.22.04.1                 all          Shared files used by the NVIDIA libraries
ii  libnvidia-compute-525:amd64                525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA libcompute package
ii  libnvidia-compute-525:i386                 525.78.01-0ubuntu0.22.04.1                 i386         NVIDIA libcompute package
ii  libnvidia-decode-525:amd64                 525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA Video Decoding runtime libraries
ii  libnvidia-decode-525:i386                  525.78.01-0ubuntu0.22.04.1                 i386         NVIDIA Video Decoding runtime libraries
ii  libnvidia-egl-wayland1:amd64               1:1.1.9-1.1                                amd64        Wayland EGL External Platform library -- shared library
ii  libnvidia-encode-525:amd64                 525.78.01-0ubuntu0.22.04.1                 amd64        NVENC Video Encoding runtime library
ii  libnvidia-encode-525:i386                  525.78.01-0ubuntu0.22.04.1                 i386         NVENC Video Encoding runtime library
ii  libnvidia-extra-525:amd64                  525.78.01-0ubuntu0.22.04.1                 amd64        Extra libraries for the NVIDIA driver
ii  libnvidia-fbc1-525:amd64                   525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA OpenGL-based Framebuffer Capture runtime library
ii  libnvidia-fbc1-525:i386                    525.78.01-0ubuntu0.22.04.1                 i386         NVIDIA OpenGL-based Framebuffer Capture runtime library
ii  libnvidia-gl-525:amd64                     525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA OpenGL/GLX/EGL/GLES GLVND libraries and Vulkan ICD
ii  libnvidia-gl-525:i386                      525.78.01-0ubuntu0.22.04.1                 i386         NVIDIA OpenGL/GLX/EGL/GLES GLVND libraries and Vulkan ICD
ii  nvidia-compute-utils-525                   525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA compute utilities
ii  nvidia-dkms-525                            525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA DKMS package
ii  nvidia-driver-525                          525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA driver metapackage
ii  nvidia-kernel-common-525                   525.78.01-0ubuntu0.22.04.1                 amd64        Shared files used with the kernel module
ii  nvidia-kernel-source-525                   525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA kernel source package
ii  nvidia-prime                               0.8.17.1                                   all          Tools to enable NVIDIA's Prime
ii  nvidia-settings                            510.47.03-0ubuntu1                         amd64        Tool for configuring the NVIDIA graphics driver
ii  nvidia-utils-525                           525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA driver support binaries
ii  screen-resolution-extra                    0.18.2                                     all          Extension for the nvidia-settings control panel
ii  xserver-xorg-video-nvidia-525              525.78.01-0ubuntu0.22.04.1                 amd64        NVIDIA binary Xorg driver
Nervous_Testpilot wrote: Sun Jan 29, 2023 7:49 amAlso so far, i have not used any PPA's that are outside of what linux mint comes bundled with.
SMG wrote: Sun Jan 29, 2023 6:40 pmLinux Mint does not come bundled with any PPAs. You have to manually add PPAs to your install to get PPAs.
Oh, sorry i didn't explain myself properly, what i meant was that i didn't add anything that is outside of what Linux Mint comes with.

I also checked out driver version 470 as suggested above but i got the same results as always.

Again thank you for your replies and time :D
User avatar
SMG
Level 25
Level 25
Posts: 31914
Joined: Sun Jul 26, 2020 6:15 pm
Location: USA

Re: Weird OpenGL Behaviour

Post by SMG »

Nervous_Testpilot wrote: Mon Jan 30, 2023 2:16 pm"On Demand" is not available to me. Only "Auto" "Adaptive" "Prefer Maximum Performance". Maximum Performance made no difference and as i understand it, this mode should be the "snappiest" of them all right?
Where are you seeing those options?

On Demand is an option for dual-graphics computers and can be seen in the nvidia-prime-applet if one has a computer with dual graphics.

You have not yet provided complete system information which makes it more difficult for others to help you. Please give us information about your install by entering this command in a terminal

Code: Select all

inxi -Fxxxrz
and enclose the results in code tags. This will let us know how Mint sees your hardware.
Image
A woman typing on a laptop with LM20.3 Cinnamon.
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

SMG wrote: Mon Jan 30, 2023 2:28 pm
Nervous_Testpilot wrote: Mon Jan 30, 2023 2:16 pm"On Demand" is not available to me. Only "Auto" "Adaptive" "Prefer Maximum Performance". Maximum Performance made no difference and as i understand it, this mode should be the "snappiest" of them all right?
Where are you seeing those options?

On Demand is an option for dual-graphics computers and can be seen in the nvidia-prime-applet if one has a computer with dual graphics.

You have not yet provided complete system information which makes it more difficult for others to help you. Please give us information about your install by entering this command in a terminal

Code: Select all

inxi -Fxxxrz
and enclose the results in code tags. This will let us know how Mint sees your hardware.
Here is what inxi -Fxxxrz tells me:

Code: Select all

System:
  Kernel: 5.15.0-58-generic x86_64 bits: 64 compiler: gcc v: 11.3.0
    Desktop: MATE 1.26.0 info: mate-panel wm: marco 1.26.0 vt: 7
    dm: LightDM 1.30.0 Distro: Linux Mint 21.1 Vera base: Ubuntu 22.04 jammy
Machine:
  Type: Desktop System: PC Specialist product: Amd Trx40 v: N/A
    serial: <superuser required>
  Mobo: ASUSTeK model: ROG ZENITH II EXTREME ALPHA v: Rev 1.xx
    serial: <superuser required> UEFI: American Megatrends v: 1603
    date: 03/04/2022
CPU:
  Info: 32-core model: AMD Ryzen Threadripper 3970X bits: 64 type: MT MCP
    smt: enabled arch: Zen 2 rev: 0 cache: L1: 2 MiB L2: 16 MiB L3: 128 MiB
  Speed (MHz): avg: 2223 high: 3594 min/max: 2200/4549 boost: enabled
    cores: 1: 2793 2: 2185 3: 2198 4: 2182 5: 2193 6: 2196 7: 2195 8: 2152
    9: 3594 10: 2052 11: 2054 12: 2049 13: 2192 14: 2196 15: 2195 16: 1881
    17: 2196 18: 2192 19: 2194 20: 2196 21: 2194 22: 2186 23: 2187 24: 2194
    25: 2194 26: 2196 27: 2185 28: 2185 29: 2196 30: 2186 31: 2208 32: 2192
    33: 2206 34: 2186 35: 2196 36: 2184 37: 2196 38: 2196 39: 2184 40: 2196
    41: 3593 42: 2044 43: 2053 44: 2052 45: 2195 46: 2196 47: 2185 48: 2196
    49: 2196 50: 2196 51: 2196 52: 2194 53: 2197 54: 2188 55: 2187 56: 2188
    57: 2187 58: 2195 59: 2184 60: 2185 61: 2194 62: 2120 63: 2069 64: 2195
    bogomips: 472732
  Flags: avx avx2 ht lm nx pae sse sse2 sse3 sse4_1 sse4_2 sse4a ssse3 svm
Graphics:
  Device-1: NVIDIA TU106 [GeForce RTX 2060 SUPER] vendor: ZOTAC
    driver: nvidia v: 525.78.01 pcie: speed: 2.5 GT/s lanes: 16 ports:
    active: none off: HDMI-A-1 empty: DP-1,DP-2,DP-3 bus-ID: 4c:00.0
    chip-ID: 10de:1f06 class-ID: 0300
  Display: x11 server: X.Org v: 1.21.1.3 compositor: marco v: 1.26.0
    driver: X: loaded: nvidia unloaded: fbdev,modesetting,nouveau,vesa
    gpu: nvidia display-ID: :0.0 screens: 1
  Screen-1: 0 s-res: 1920x1080 s-dpi: 92 s-size: 530x301mm (20.9x11.9")
    s-diag: 610mm (24")
  Monitor-1: HDMI-0 res: 1920x1080 hz: 60 dpi: 92
    size: 531x299mm (20.9x11.8") diag: 609mm (24")
  OpenGL: renderer: NVIDIA GeForce RTX 2060 SUPER/PCIe/SSE2
    v: 4.6.0 NVIDIA 525.78.01 direct render: Yes
Audio:
  Device-1: AMD Starship/Matisse HD Audio vendor: ASUSTeK driver: N/A pcie:
    speed: 16 GT/s lanes: 16 bus-ID: 23:00.4 chip-ID: 1022:1487 class-ID: 0403
  Device-2: NVIDIA TU106 High Definition Audio vendor: ZOTAC
    driver: snd_hda_intel v: kernel pcie: speed: 8 GT/s lanes: 16
    bus-ID: 4c:00.1 chip-ID: 10de:10f9 class-ID: 0403
  Device-3: ASUSTek USB Audio type: USB
    driver: hid-generic,snd-usb-audio,usbhid bus-ID: 9-5:5 chip-ID: 0b05:1916
    class-ID: 0300
  Device-4: ASUSTek USB Audio type: USB
    driver: hid-generic,snd-usb-audio,usbhid bus-ID: 9-6:6 chip-ID: 0b05:1915
    class-ID: 0300
  Sound Server-1: ALSA v: k5.15.0-58-generic running: yes
  Sound Server-2: PulseAudio v: 15.99.1 running: yes
  Sound Server-3: PipeWire v: 0.3.48 running: yes
Network:
  Device-1: Aquantia AQC107 NBase-T/IEEE 802.3bz Ethernet [AQtion]
    vendor: ASUSTeK driver: atlantic v: kernel pcie: speed: 8 GT/s lanes: 2
    port: N/A bus-ID: 44:00.0 chip-ID: 1d6a:07b1 class-ID: 0200
  IF: enp68s0 state: down mac: <filter>
  Device-2: Intel I211 Gigabit Network vendor: ASUSTeK driver: igb
    v: kernel pcie: speed: 2.5 GT/s lanes: 1 port: 9000 bus-ID: 47:00.0
    chip-ID: 8086:1539 class-ID: 0200
  IF: enp71s0 state: down mac: <filter>
  Device-3: Intel Wi-Fi 6 AX200 driver: iwlwifi v: kernel pcie:
    speed: 5 GT/s lanes: 1 bus-ID: 48:00.0 chip-ID: 8086:2723 class-ID: 0280
  IF: wlp72s0 state: up mac: <filter>
Drives:
  Local Storage: total: 1.38 TiB used: 310.75 GiB (22.1%)
  ID-1: /dev/sda vendor: Samsung model: SSD 860 PRO 512GB size: 476.94 GiB
    speed: 6.0 Gb/s type: SSD serial: <filter> rev: 2B6Q scheme: GPT
  ID-2: /dev/sdb vendor: Seagate model: ST1000LM049-2GH172 size: 931.51 GiB
    speed: 6.0 Gb/s type: HDD rpm: 7200 serial: <filter> rev: SDM1
Partition:
  ID-1: / size: 465.29 GiB used: 155.2 GiB (33.4%) fs: ext4 dev: /dev/dm-1
    mapped: vgmint-root
  ID-2: /boot size: 1.61 GiB used: 358.9 MiB (21.8%) fs: ext4
    dev: /dev/sda2
  ID-3: /boot/efi size: 511 MiB used: 5.2 MiB (1.0%) fs: vfat
    dev: /dev/sda1
Swap:
  ID-1: swap-1 type: partition size: 980 MiB used: 0 KiB (0.0%) priority: -2
    dev: /dev/dm-2 mapped: vgmint-swap_1
Sensors:
  System Temperatures: cpu: N/A mobo: N/A gpu: nvidia temp: 37 C
  Fan Speeds (RPM): N/A gpu: nvidia fan: 37%
Repos:
  Packages: 2312 apt: 2285 flatpak: 27
  No active apt repos in: /etc/apt/sources.list
  Active apt repos in: /etc/apt/sources.list.d/official-package-repositories.list
    1: deb https://ftp-stud.hs-esslingen.de/pub/Mirrors/packages.linuxmint.com vera main upstream import backport
    2: deb http://ftp-stud.hs-esslingen.de/ubuntu jammy main restricted universe multiverse
    3: deb http://ftp-stud.hs-esslingen.de/ubuntu jammy-updates main restricted universe multiverse
    4: deb http://ftp-stud.hs-esslingen.de/ubuntu jammy-backports main restricted universe multiverse
    5: deb http://security.ubuntu.com/ubuntu/ jammy-security main restricted universe multiverse
Info:
  Processes: 791 Uptime: 2h 40m wakeups: 0 Memory: 31.19 GiB
  used: 5.59 GiB (17.9%) Init: systemd v: 249 runlevel: 5 Compilers:
  gcc: 11.3.0 alt: 11 Shell: Bash v: 5.1.16 running-in: mate-terminal
  inxi: 3.3.13
Regarding the options "Maximum Performance" "Auto" "Adaptive" i see these options in the "NVIDIA X Server Settings" app.

I might have stumbled upon something that is probably strongly related to the problem. In the nvidia x server settings app, under the tab "X Server Display Configuration", you can enable "Force Composition Pipeline" and "Force Full Composition Pipeline". If any of these options is enabled, the described stuttering appears way more frequently and also way earlier (almost instantly). So, with no "force composition" and/or no "force full composition pipeline" it can take a few minutes until the stuttering occurs. Frame-rates stay unaffected and stable, regardless of what is enabled. The stuttering problem, using the glxgears-test, is almost inverted. When no composition pipeline is enforced, then the gears stutter, as soon as they are rendered and they stutter the whole time. with full composition pipeline enforced, the stuttering is way more subtle and sometimes, in 1:10 cases, there is no stuttering at all.
User avatar
SMG
Level 25
Level 25
Posts: 31914
Joined: Sun Jul 26, 2020 6:15 pm
Location: USA

Re: Weird OpenGL Behaviour

Post by SMG »

Nervous_Testpilot wrote: Tue Jan 31, 2023 1:36 pmMachine:
Type: Desktop System: PC Specialist product: Amd Trx40 v: N/A
serial: <superuser required>
Mobo: ASUSTeK model: ROG ZENITH II EXTREME ALPHA v: Rev 1.xx
serial: <superuser required> UEFI: American Megatrends v: 1603
date: 03/04/2022
If this is the correct link Product Support for ROG Zenith II Extreme Alpha: BIOS there is a newer version available, Version 1701, which indicates "1. Improve system stability". Maybe that will help.
Image
A woman typing on a laptop with LM20.3 Cinnamon.
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

SMG wrote: Tue Jan 31, 2023 3:18 pm
Nervous_Testpilot wrote: Tue Jan 31, 2023 1:36 pmMachine:
Type: Desktop System: PC Specialist product: Amd Trx40 v: N/A
serial: <superuser required>
Mobo: ASUSTeK model: ROG ZENITH II EXTREME ALPHA v: Rev 1.xx
serial: <superuser required> UEFI: American Megatrends v: 1603
date: 03/04/2022
If this is the correct link Product Support for ROG Zenith II Extreme Alpha: BIOS there is a newer version available, Version 1701, which indicates "1. Improve system stability". Maybe that will help.
Ok i give this one a shot and test the system, to see if something improves.
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

SMG wrote: Tue Jan 31, 2023 3:18 pm
Nervous_Testpilot wrote: Tue Jan 31, 2023 1:36 pmMachine:
Type: Desktop System: PC Specialist product: Amd Trx40 v: N/A
serial: <superuser required>
Mobo: ASUSTeK model: ROG ZENITH II EXTREME ALPHA v: Rev 1.xx
serial: <superuser required> UEFI: American Megatrends v: 1603
date: 03/04/2022
If this is the correct link Product Support for ROG Zenith II Extreme Alpha: BIOS there is a newer version available, Version 1701, which indicates "1. Improve system stability". Maybe that will help.
Hello, im back to report some news. Sorry it took some time to answer, because i had to test a lot, and i wanted to make sure my observations are correct, so i had to take a few days, so i can test stuff for hours, not just take a quick glance and then draw a conclusion...

Well there are good news and there are bad news.

First of all, updating the bios made no change. I reverted back to the previous version i had installed before, in the weird hope something would change but nope no chance.

But now for the "good" news. My friend gave me one of his spare ssd he has currently no use for, so i can test different operating systems without wiping the current one. This should allow for a test with a operating system as vanilla as humanly possible. So hopefully no weird conflicts of any kind. On any operating system i tested devildaggers and glxgears (with and without VSYNC/VBLANK). Graphic Drivers were installed only by the driver manager gui. The goal was to test out as many drivers as possible. If a driver tests as bad, i would reset back to nouveau xorg drivers, then reset the system to it's vanilla state (using Timeshift with RSYNC), apply updates and then install another driver to test.

So i tested the following operating systems:

Linux Mint 21.1
Linux Mint 21 (Vanessa)
Ubuntu 20.04 LTS
Windows 10 64bit Professional

The results were quite interesting.

Mint 21 Vanessa has the same problem as 21.1 In fact none of the drivers (470, 510, 515, 525) work properly, not even the nouveau drivers, both in Mint 21.1 and 21.
But on 21 vanessa, the opensource versions of the nvidia drivers, were available. I tried them out too after i tested the proprietary ones. They crash and burn my system as soon as i open the "NVIDIA X Server Settings" menu. And by crash i mean, the system isn't even able to open and display a tty-terminal. Never had that happen on Linux.

For reference, and because i slowly i thought i might go crazy, i installed Windows 10 64 bit and tested devildaggers on it. No problems at all. Other opengl driven applications also show no problems. hmmmmm...

So i wiped everything, and went ahead to Ubuntu 20.04 LTS. Under Ubuntu i tested the proprietary nvidia drivers first because they were installed by default. 515 had troubles with steam, but 525 runs absolutely perfectly. It's the SAME version (525.78.01) available in Mint21 Vanessa and Mint 21.1... So the problem is definitely NOT present in Ubuntu 20.04, even tough it uses the same drivers, be it in devildaggers or glxgears (tested with glxgears -fullscreen and __GL_SYNC_TO_VBLANK=0 glxgears -fullscreen). I did the tests for 5 hours straight, because i couldn't believe my own eyes, but here we are.

Could this be just a weird mixture of hardware and software issues, only present in Linux Mint 21 and 21.1, that for some reason don't show up in Ubuntu 20.04?

If so, that would be a damn shame, i like Linux Mint a lot, never was a big fan of Ubuntu...
Would there be a way to at least deduce, what's so fundamentally different, when it comes to opengl (if it even is about opengl) between Ubuntu and Linux Mint, so i can maybe fix it manually, or is this like searching for a needle in a haystack?
User avatar
SMG
Level 25
Level 25
Posts: 31914
Joined: Sun Jul 26, 2020 6:15 pm
Location: USA

Re: Weird OpenGL Behaviour

Post by SMG »

Nervous_Testpilot wrote: Tue Feb 07, 2023 12:38 pm First of all, updating the bios made no change. I reverted back to the previous version i had installed before, in the weird hope something would change but nope no chance.
I do not understand why you would update your system and then revert back when the update was not causing problems. Manufacturers do not spend time and money to make updates unless they are needed.
Nervous_Testpilot wrote: Tue Feb 07, 2023 12:38 pmSo i tested the following operating systems:

Linux Mint 21.1
Linux Mint 21 (Vanessa)
Ubuntu 20.04 LTS
Ubuntu 20.04 is the base for Linux Mint 20 versions. If you wanted to compare Linux Mint and Ubuntu, you should have used Ubuntu 22.04.
Nervous_Testpilot wrote: Tue Feb 07, 2023 12:38 pmBut on 21 vanessa, the opensource versions of the nvidia drivers, were available. I tried them out too after i tested the proprietary ones. They crash and burn my system as soon as i open the "NVIDIA X Server Settings" menu.
I'm not sure what you mean by "opensource version of the Nvidia drivers", but if you mean the drivers with "open" in the name, there are special instructions one should follow to install them properly and even then are still alpha quality in many aspects. (Nvidia says this in their documentation.) If you were wanting to test OpenGL behaviour, using the opensource version of the drivers makes no sense at all.
Nervous_Testpilot wrote: Tue Feb 07, 2023 12:38 pmWould there be a way to at least deduce, what's so fundamentally different, when it comes to opengl (if it even is about opengl) between Ubuntu and Linux Mint, so i can maybe fix it manually, or is this like searching for a needle in a haystack?
There is nothing fundamentally different when it comes to OpenGL between Ubuntu and Linux Mint. They use the same code when one uses the same base version of Ubuntu. If you wanted a comparison of Ubuntu 20.04, you should have tested Linux Mint 20.3.
Image
A woman typing on a laptop with LM20.3 Cinnamon.
Nervous_Testpilot
Level 1
Level 1
Posts: 17
Joined: Sun Oct 02, 2022 11:37 am

Re: Weird OpenGL Behaviour

Post by Nervous_Testpilot »

SMG wrote: Tue Feb 07, 2023 5:07 pm
Ok i think i made some progress and things got weird. As suggested, for better comparison, i installed Ubuntu 22.04 LTS. It had the same problem as Mint 21.1. The stuttering was behaving differently but in essence it was the same. So after a lot of driver switching and testing, i thought it was of no use and next i'll install Linux Mint 20.3 so i can have a more complete picture.

Here is were things got weird. First of all the installer refused to start with UEFI BIOS. It would result in BIOS error messages on the screen, which were corrupted on top of that. Lines were missing, trippy colors all over the place, garbled up letters, it looked like corrupted/faulty memory. After a few retries, all resulting in corruption, i grew a bit concerned. I put the bios into legacy mode so i could run memtest86+, from the Ubuntu 20.04 install medium, for about 24 hours. In the end no memory errors were found.

Next i thought maybe Mint 20.3 will work, if i let the BIOS stay in legacy mode and give it a try. And yes it worked, it booted right into the Live environment.
So, another thought crossed my mind. Maybe the BIOS-Chip itself is faulty, so i shut the PC down and checked if my motherboard has a second bios chip. It did. So i switched into the Backup Bios. After switching i checked if the BIOS is on the second chip now and in what mode it is.
The switch was successfull and it was in UEFI mode. Then i booted back into Ubuntu 22.04

The problem was completely GONE, no more stuttering, nothing.

Now one would think, that the original BIOS-Chip is somehow faulty, but i don't think so. Why?
Because to test this theory, i switched back into the original BIOS chip, set it back to UEFI, boot into Ubuntu 22.04 and the stuttering was also gone now, but when i boot into Mint 21.1, the installation that had the problem initially, the problem is still there. Only now it happens less often but it's still very noticeable.

So to summarize:

Ubuntu 20.04 LTS - No problems at all
Ubuntu 22.04 LTS - Stuttering but somehow healed itself after BIOS-chip switching (???)
Mint 21.1 - Problem still persists, regardless of BIOS-Chip
Mint 20.3 - Refuses to install when UEFI is active
Windows 10 - No Problems at all

I'm a bit confused right now about what to do next, in the last 20 years i never saw a bios chip that is marginal, they were either working or broken on the other hand, is it possible that UEFI is causing troubles for Linux to access the hardware properly, depending on which release you use? From what i have read, yes UEFI can be finicky, sometimes. But then what's the deal with Ubuntu 22.04, somehow fixing itself, regardless of what BIOS chip is in use????

Anyway, time for some more tests i think. Next i'll disable UEFI on the original BIOS chip and then reinstall Mint 21.1, hopefully that fixes things finally
Last edited by SMG on Tue Feb 14, 2023 5:27 pm, edited 1 time in total.
Reason: Reduced quote which was a complete repeat of the prior post. No need to duplicate it.
Locked

Return to “Software & Applications”