inference problem #144
Loading…
Add table
Add a link
Reference in a new issue
No description provided.
Delete branch "%!s()"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Exception in thread Thread-7:
Traceback (most recent call last):
File "/data/starCoder/software/conda/envs/torch/lib/python3.8/threading.py", line 932, in _bootstrap_inner
self.run()
File "/data/starCoder/software/conda/envs/torch/lib/python3.8/threading.py", line 870, in run
self._target(*self._args, **self._kwargs)
File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/torch/utils/_contextlib.py", line 115, in decorate_context
return func(*args, **kwargs)
File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/transformers/generation/utils.py", line 1648, in generate
return self.sample(
File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/transformers/generation/utils.py", line 2730, in sample
outputs = self(
File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/transformers/models/gpt_bigcode/modeling_gpt_bigcode.py", line 808, in forward
transformer_outputs = self.transformer(
File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/torch/nn/modules/module.py", line 1501, in _call_impl
return forward_call(*args, **kwargs)
File "/data/starCoder/software/conda/envs/torch/lib/python3.8/site-packages/transformers/models/gpt_bigcode/modeling_gpt_bigcode.py", line 605, in forward
self_attention_mask = self_attention_mask * attention_mask.view(batch_size, 1, -1).to(
RuntimeError: The size of tensor a (8192) must match the size of tensor b (8193) at non-singleton dimension 2
When I engage in long conversations, an error occurs halfway through. how to fix it？