Using render_browser when the env.render() is on an external function

[ValerioB88]

Hi. First of all, thank you for the script, amazingly useful!
I was wondering if there is a way to use it when env.render is somewhere else than the main function. For example

@render_browser
def external_env(env):
    yield env.render(mode='rgb_array')
    obs, rew, done, _ = env.step(env.action_space.sample())
    if done:
        env.reset()

def test_policy():
    env = gym.make('Breakout-v0')
    obs = env.reset()
    counter = 0
    while True:
        external_env(env)
        print(f"COUNTER: {counter}")  # this doesn't get called

test_policy()

The function seems to send one step through the browser and then stops.
Any idea?

Thanks!

[ddharshan]

Hi
Did you solve this problem?

[ValerioB88]

Depends on what you want to do. You can do something like this

from render_browser import render_browser
import gym

@render_browser
def external_env(env):
    while True:
        yield env.render(mode='rgb_array')
        obs, rew, done, *_ = env.step(env.action_space.sample())
        if done:
             env.reset()

def test_policy():
    env = gym.make('CartPole-v0')
    obs = env.reset()
    counter = 0
    external_env(env)
    print(f"COUNTER: {counter}")  # this doesn't get called

test_policy()

[ddharshan]

Did you implement dhruvramani's project in your server? I am getting error when i run the render.py code
The error is - BuildError
werkzeug.routing.exceptions.BuildError: Could not build url for endpoint 'render_feed'. Did you mean 'index' instead?

[ddharshan]

It worked

Do you know why the cartpole's color is different than the actual one?

[ValerioB88]

Is the fact that this tool uses opencv, which switches the RGB values to BGR. You can switch it before passing it to the render browser, so that when it switches it, it's the right way around. That is: ```python from render_browser import render_browser import gym import cv2 @render_browser def external_env(env): while True: yield cv2.cvtColor(env.render(mode='rgb_array'), cv2.COLOR_RGB2BGR) obs, rew, done, *_ = env.step(env.action_space.sample()) if done: env.reset() def test_policy(): env = gym.make('CartPole-v0') obs = env.reset() counter = 0 external_env(env) print(f"COUNTER: {counter}") # this doesn't get called test_policy() ``` this works for me

…

On Fri, 7 Oct 2022 at 11:35, Dharshan ***@***.***> wrote: It worked [image: image] <https://user-images.githubusercontent.com/108181384/194522774-3b3afb11-484f-4f0e-8c5b-ea981a65ed72.png> Do you know why the cartpole's color is different than the actual one? — Reply to this email directly, view it on GitHub <#2 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEDH7BVIAXAUKPSB4LLJQKLWB7VFHANCNFSM6AAAAAAQDGP7ZE> . You are receiving this because you authored the thread.Message ID: ***@***.***>

[ddharshan]

Is the fact that this tool uses opencv, which switches the RGB values to BGR. You can switch it before passing it to the render browser, so that when it switches it, it's the right way around. That is: python from render_browser import render_browser import gym import cv2 @render_browser def external_env(env): while True: yield cv2.cvtColor(env.render(mode='rgb_array'), cv2.COLOR_RGB2BGR) obs, rew, done, *_ = env.step(env.action_space.sample()) if done: env.reset() def test_policy(): env = gym.make('CartPole-v0') obs = env.reset() counter = 0 external_env(env) print(f"COUNTER: {counter}") # this doesn't get called test_policy() this works for me
…
On Fri, 7 Oct 2022 at 11:35, Dharshan @.> wrote: It worked [image: image] https://user-images.githubusercontent.com/108181384/194522774-3b3afb11-484f-4f0e-8c5b-ea981a65ed72.png Do you know why the cartpole's color is different than the actual one? — Reply to this email directly, view it on GitHub <#2 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEDH7BVIAXAUKPSB4LLJQKLWB7VFHANCNFSM6AAAAAAQDGP7ZE . You are receiving this because you authored the thread.Message ID: @.>

Got it . Thank you very much

[ValerioB88]

Yes, it works for me. So when you execute the script above you get that error?

…

On Thu, 6 Oct 2022 at 15:12, Dharshan ***@***.***> wrote: Did you implement dhruvramani's project in your server? I am getting error when i run the render.py code The error is - BuildError werkzeug.routing.exceptions.BuildError: Could not build url for endpoint 'render_feed'. Did you mean 'index' instead? — Reply to this email directly, view it on GitHub <#2 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AEDH7BRCFBVWP4BXL6Y42U3WB3F3XANCNFSM6AAAAAAQDGP7ZE> . You are receiving this because you authored the thread.Message ID: ***@***.***>