@thomasfuchs the unsloth q4_k_xl quant of that seems to do ok and will probably be much faster to cycle. The unsloth page also gives a bunch of guidance on tuning to reduce how much looping it gets up to. https://unsloth.ai/docs/models/qwen3.6
@thomasfuchs the unsloth q4_k_xl quant of that seems to do ok and will probably be much faster to cycle. The unsloth page also gives a bunch of guidance on tuning to reduce how much looping it gets up to. https://unsloth.ai/docs/models/qwen3.6
GNU social JP is a social network, courtesy of GNU social JP管理人. It runs on GNU social, version 2.0.2-dev, available under the GNU Affero General Public License.
All GNU social JP content and data are available under the Creative Commons Attribution 3.0 license.