Community Profile

photo

Takeshi Takahashi

MathWorks

Last seen: 1 day ago Active since 2021

Statistics

  • Knowledgeable Level 2
  • First Answer

View badges

Content Feed

View by

Answered
PPO algorithm training problem in Reinforcement Learning Toolbox
When N is smaller than ExperienceHorizon and N is also smaller than MiniBatchSize, the PPO agent uses N experiences to update i...

9 months ago | 0

| accepted

Answered
Creating an actorLossFunction for ContinuousDeterministicActor
Please take a look at this example for rlContinuousDeterministicActor if you want to use it in a custom training loop. rlDiscre...

2 years ago | 0

| accepted

Answered
Why does Soft actor critic have Entropy terms instead of Log probability?
RL toolbox also uses the log of the probability density to approximate the differential entropy.

2 years ago | 0

| accepted

Answered
ExperienceBuffer has 0 Length when i load a saved agent and continue training in reinforcement training
Length 0 means there isn't any experience in this buffer. I think it didn't save the experience buffer due to this bug. Please s...

3 years ago | 0

| accepted

Answered
How does RL algorithm work with RNNs?
Hi, rlDDPGAgent with RNN first randomly samples B sequences (trajectories) from the experience buffer, where B is MiniBatchSize...

3 years ago | 0

| accepted