Spaces:

toninio19
/

keysync-demo

Running on Zero

Antoni Bigata commited on 25 days ago

Commit

d9970e1

1 Parent(s): 6ea1ef7

requirements

Files changed (1) hide show

WavLM_modules.py CHANGED Viewed

@@ -450,9 +450,9 @@ class MultiheadAttention(nn.Module):
         relative_position_bucket = self._relative_positions_bucket(
             relative_position, bidirectional=True
         )
-        relative_position_bucket = relative_position_bucket.to(
-            self.relative_attention_bias.weight.device
-        )
         values = self.relative_attention_bias(relative_position_bucket)
         values = values.permute([2, 0, 1])
         return values

         relative_position_bucket = self._relative_positions_bucket(
             relative_position, bidirectional=True
         )
+        # relative_position_bucket = relative_position_bucket.to(
+        #     self.relative_attention_bias.weight.device
+        # )
         values = self.relative_attention_bias(relative_position_bucket)
         values = values.permute([2, 0, 1])
         return values