Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

details of input & output of LSTM #3

Open
machanic opened this issue Mar 4, 2018 · 0 comments
Open

details of input & output of LSTM #3

machanic opened this issue Mar 4, 2018 · 0 comments

Comments

@machanic
Copy link

machanic commented Mar 4, 2018

I repeat my understanding about your codes, can you tell me is it exactly what you mean?
In this example , I omit the procedure of random sample, just look it.
suppose we have sequence of a,b,c,d,e,f,g.
the LSTM's 1st time input : a,b,c and output: o_a, o_b, o_c. you need to concatenate (o_a, o_b, o_c) to calculate loss, all ground truth of (label_a, label_b, label_c) will be used in calculate loss.
the LSTM's 2nd time input: b,c,d and output: o_b,o_c, o_d you need to concatenate (o_b, o_c, o_d) to calculate loss, all ground truth of (label_b, label_c, label_d) will be used in calculate loss.

so my question is:

  1. is this example I showed exactly what you do in your experiment?
  2. In this example, In order to train the whole dataset, so overlap sequence will repeatly input to LSTM in order to calcuate all position of sequence.
    3..Because there exists a lot of 0-label (image frame with no action on its face) frame, Do you train every sample in train set OR just pick that frame which have AU label != 0. input to LSTM?
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant