Skip to content

Commit

Permalink
fix args
Browse files Browse the repository at this point in the history
  • Loading branch information
PeterSH6 committed Jan 10, 2025
1 parent c39a93f commit 7e39c47
Showing 1 changed file with 4 additions and 2 deletions.
6 changes: 4 additions & 2 deletions verl/utils/torch_functional.py
Original file line number Diff line number Diff line change
Expand Up @@ -334,9 +334,11 @@ def log_probs_from_logits_all_rmpad(input_ids_rmpad, logits_rmpad, indices, batc
for large vocab_size
Args:
input_ids: [batch_size, seqlen]
attention_mask: [batch_size, seqlen]
input_ids_rmpad: [1, total_nnz]
logits_rmpad: [total_nnz, vocab_size]
indices: [total_nnz]
batch_size: int
seqlen: int
response_length: int
"""
from flash_attn.bert_padding import pad_input
Expand Down

0 comments on commit 7e39c47

Please sign in to comment.