INT8 Convrot

#1
by Talanca - opened

Is an INT8 Convrot version possible?
I would do the quantization myself, but my quant node doesn't have the MOSS profile to select the proper quantization.

uh, bruh, if you want to use int8 convrot it will just works isn't it? bcuz int8 convrot make matmul happen in int8, and activation natively sit in fp32?
fp16 fix ckpt is for fp16 fix usage somehow

Sign up or log in to comment