menu
announcement

Spectrum is now read-only. Learn more about the decision in our official announcement.

snorkel

Building and managing training datasets for machine learning

Channels
Team
Posts
Members
Info

Trying to create dataset for creating a model for visual relationship Detection

Hi All, I am trying to solve use case for which we have to create a model but whatever VRD datasets and predicates are available that is not solving our use case. So is it possible to create a new datasets in the same format subject, object and predicates, bbox. …

message-simple
6

# Help

I'm having trouble with loading the unlabeled comments on macOS, I'm getting this error message from: can't read /var/mail/snorkel.labeling What did I do wrong?

message-simple
7

Data Augmentation in structured categorical dataset.

I am working with categorical dataset such as 'Adult'. I want to augment the data using weak supervision. Any leads will be helpful.

message-simple
3

Data Slicing

Hi! I applied the labeling and transformation functions on my 3 million of sentences. Now, I’m trying to apply the SliceAwareClassifier but it needs more than 12GB of RAM for only 5000 sentences, is it normal? Are there other models to improve the slice performance?

message-simple
1

Struggle to put all the pieces together in the snorkel pipeline

Struggle to put all the pieces together in the snorkel pipeline Hello! I’m using snorkel in my master thesis on textual data to categorize comments into a set of different categories. I have gone through the tutorials on the snorkel tutorial github page but still struggles…

message-simple
2

# scalability of snorkel

I just stumbled upon snorkel and I am awed at this amazing and highly impactful effort! I went through all the snorker tutorials and it was quite easy to follow how to use use it to get the final probabilistic labels. However, it was not clear how scalable things are. …

message-simple
6

How to use Snorkel on numeric data?

Hi - I'm trying to see if I can use Snorkel to label my numeric training dataset (and then looking to either do label classification or convert the labels to scores and do a regression classification). My question is if there are coding examples anywhere that show how to use…

message-simple
1

Widely varying results when training multi-task model on same inputs

Hello! I'm in the process of writing a paper comparing the efficacy of multi-task models with weak supervision to the performance of their single-task equivalents, and I've been using Snorkel v0.9.6 to explore this. However, I've been experiencing a strange issue in that when…

message-simple
2

How to import the GenerativeModel?

I am following this tutorial(https://www.youtube.com/watch?v=2bhBe9HGuSQ) by @jfries for training a generative model, in the notebook shown in video, the following import is used from snorkel.learning import GenerativeModel, but when I execute the following command, I get the…

message-simple
13

Is it possible to assign weights on label functions

Hi, dear Snorkel community, I am relatively new to using Snorkel. My purpose is to use Snorkel to generate labels for a dataset we got. So far, we came up with dozens of rules, which are mainly based on domain knowledge of the data. Domain knowledge gave us hints that these…

message-simple
3