When I stream (1 camera, some images and text) with OBS minimized, it uses about 250 MB of RAM. I can't imagine game capture uses a significant amount of RAM. Should be fine for recording. Use a single source scene collection to keep the RAM usage low. Disable the preview once you got everything setup.
When streaming, you may have more sources such as a cam, browser sources for stats, etc. These use additional RAM.