Hi Aksh, I’m looking to reproduce the CAI process in the HuggingFace tutorial myself. Did you publish your code for this? I’m having a hard time getting LLMSwarm to work so I’m eager to see your setup.
Hi Deco! I did not end up using LLMSwarm. As far as I understand, it’s particularly useful when you have multiple GPUs and you can parallelize the computations (for eg. when creating the datasets). I was using only one GPU on Google Colab for my setup, so it didn’t seem to fit my use case.
I haven’t yet published my code for this—it’s a bit messy and I was hoping to streamline it when I get the time before making it public. However, I’d be happy to give you (or anyone) access in the meantime, if they are in a hurry and want to take a look.
Hi Aksh, I’m looking to reproduce the CAI process in the HuggingFace tutorial myself. Did you publish your code for this? I’m having a hard time getting LLMSwarm to work so I’m eager to see your setup.
Hi Deco! I did not end up using LLMSwarm. As far as I understand, it’s particularly useful when you have multiple GPUs and you can parallelize the computations (for eg. when creating the datasets). I was using only one GPU on Google Colab for my setup, so it didn’t seem to fit my use case.
I haven’t yet published my code for this—it’s a bit messy and I was hoping to streamline it when I get the time before making it public. However, I’d be happy to give you (or anyone) access in the meantime, if they are in a hurry and want to take a look.