JTh34's picture
Add new SentenceTransformer model
a782339 verified
---
tags:
- sentence-transformers
- sentence-similarity
- feature-extraction
- generated_from_trainer
- dataset_size:700
- loss:MatryoshkaLoss
- loss:MultipleNegativesRankingLoss
base_model: Snowflake/snowflake-arctic-embed-l
widget:
- source_sentence: How can I ensure that my puppy's emotional and psychological needs
are being met during training to promote better social skills and emotional stability?
sentences:
- Look for wiggling body language, happy faces, and play bows from both dogs. Bouncy
exaggerated rocking-horse type movements are a sign the dogs are having fun. Determine
whether your dog wants to run back and play with another dog by giving a consent
test. Separate the dogs, remove your dog some distance away, then observe whether
your dog wants to run back and play with the other dog or not. Dogs should be
self-imposing breaks from play to rest or get a small drink. Breaks may include
sniffing. If one dog wants a break the other dog shows respect by not persisting
in perpetual play inducements. If your dog comes and lies down near you, take
the lead, and protect your dog from further interaction until your dog desires
another round of play. Sniffing may be in order. Puppies and adult dogs must be
monitored very carefully as should small dogs vs. large dogs. Not all adult dogs
like puppies. Large adult dogs should change levels, that is voluntarily self-
handicap, and let the puppy or smaller dog “win” regularly during role reversals.
These behaviors balance inequalities in size, strength, and health. If role-reversals
or self-handicapping are not occurring, do not allow your puppy or small dog continued
interaction with an adult or much larger dog who may show aggression or cause
physical or emotional injury. One dog may be either the victim or the bully in
different contexts. Roles may also change when playing with different play partners.
Dogs should take turns happily chasing each other where neither dog is a bully
or a target, so play goes back and forth. With puppies, adult dogs should be willing
to let the puppy win now and again and should always back off if the puppy squeals.
- 'The priorities, best practices and the exclusions define what force-free training
is and in addition what it is not. Force-free training is categorically and qualitatively
different and unique from traditional or so-called “balance training” by virtue
of the operational definition of what we do and what we do not do as described
below.
No shock No prong No choke No pain No fear No dominance or intimidation No compulsion
methods No physical force No hitting with any object, including rolled up towels
No throwing items No swatting with a newspaper No shaking cans of coins or rocks
in our dogs’ sensitive ears No spraying water in the face or body No yelling
Nurturing biological health and psychological well-being enhances emotional stability,
social skills, and cognitive abilities by meeting our dogs’ real needs. The Hierarchy
of Dog Needs describes the emotional and behavioral modification methods that force-free
behavior modification consultants and trainers endorse. Effectively using these
techniques serves to increase, decrease, and redirect behavior, and also to change
emotional responses. We set the stage for optimal well-being by using force-free
training, and eliminating the potentiality for fear, stress, and aggression.'
- 'Many properties of commercially prepared dog food are not sufficiently regulated.
We suggest that you
Read the ingredients on labels and choose a food with a specifically named protein
source as the first ingredient. Avoid the vague term “meat,” by-products, corn
syrup, and sugar. Meat meal is generally rendered meat made of by-products and
that is why you will not see meat meals in human foods. Avoid meat meals when
there are higher quality alternatives. Avoid artificial flavors, colors, and preservatives,
especially BHA, BHT, and ethoxyquin that may be linked to carcinogens. Artificial
preservatives may be toxic to your dogs: Some artificial preservatives are also
used as pesticides.
Consider the following questions when choosing a brand of dog food
Sources. Where do the ingredients come from? Recalls. What is the manufacturer’s
safety record? Marketing and customer service. Is the company transparent about
its products and responsive to inquiries?'
- source_sentence: How can I ensure my puppy doesn't have potty accidents when I'm
not watching her closely?
sentences:
- 'attached to you by a leash so she canʼt wander off to potty in the house
or under your direct supervision in an enclosed area. Direct supervision means
you are looking at her at all times. The minute you turn away, sheʼll have a potty
accident.
Stick to this plan for a month straight and sheʼll reliably develop the habit
of going outside and holding it inside. Then continue keeping a close eye on her
for another couple of months, especially when you take her on outings to other
peopleʼs homes, before declaring her completely potty trained.
The goal of crate training is that your puppy learns to love resting in her crate.
Crate: Your puppy should sleep in her crate at night and take naps in it during
the day. To train her to love her crate, you can make it comfortable with a blanket
and
place treats inside at random times. Then give her toys and pet her when sheʼs
in it
before you close the door. The ultimate goal of crate training is that she goes
into
the crate on her own or when you give her a verbal cue, rather than needing to
be
shoved or coaxed in. And once sheʼs in, she remains calm, relaxed and quiet. (If
you have problems with this, download the crate training handout at
Crate size: The crate should be big enough for the puppy to lie down and turn
around but not big enough for a separate potty area. You can make the crate
smaller by placing a box in it and, as the puppy grows, enlarge the crate by using
a
“The goal of crate training is that your puppy learns to love resting in her crate.”'
- 'Does your puppy love their food? If so, use it to reward them throughout the
day. Portion out some or all of the food and use it to motivate quick responses
and self-control. (For more on how to use food to inspire learning, check out
Part 4 of this book.)
Water is critically important for your puppy’s well-being: it should be left out
and available at all times. That said, try to monitor their drinking habits while
house- training them. Establish a drinking station for your puppy and keep their
dish there, whether it’s empty or full. Give water with meals, after playing,
chewing, or napping, and as you’re on your way to the potty area.
Restrict water after 7:30 p.m., unless you want to be up all night taking your
puppy outside. If your puppy needs a drink, either give them a small amount or
offer a couple of ice cubes.
Although dogs have many fewer taste buds overall (humans have 9,000 to their 1,700),
your puppy has a ring of taste buds on the tip of their tongue that make water
taste sweet. Pretty cool.
I don’t think house-training can be summed up any better than with the wonder-
ful maxim “Whatever goes in must come out.” Your puppy’s biological clock will
have them eliminating on demand. When their bladder or bowels are pressed, they’ll
let loose whether they’re outside or on the papers — or the rug, if you’re not
watching.'
- 'After a puppy’s peak socialization period, around 16 weeks of age, it’s impos-
sible to turn back the clock. People, places, sights, and smells that your puppy
would have conditioned to naturally at an early age will seem suspicious to an
older puppy. Do you want a dog who can’t warm up to everyday stimulations?
Puppies who are overisolated or stressed during infancy are shown to chew more
destructively and may wreck your furnishings if they aren’t conditioned to chew
their toys. The early turmoil created nervous energy that needs to be displaced,
and because running to the refrigerator is off limits and nail-biting
isn’t an option, your puppy will chew on whatever is available. Provide plenty
of satisfying options or else you may see your sofa disappear, one cushion at
a time.
» Shelter: If you find an older puppy at a shelter, ask about their history and
try to find out why they were left there. Were they found on the side of the street,
or have they grown up in the system? Has the puppy in question been returned more
than once? Ask what the reasons were — you may be adopting a dog who couldn’t
be house-trained, was fearful of kids, or showed aggression when chewing a bone.
Find out what the staff thinks of the puppy’s personality. » Pet store, puppy
broker, craigslist, and other sources: Discount shopping isn’t for puppies. Do
not buy a puppy without meeting and talking to the breeder or rescuers first.
Though you may read a phrase that makes you feel like you’ll be the winner, there
are no winners in the online puppy shopping game. Buying a puppy in this manner
ensures that more puppies will be bred this way, which doesn’t take their interests
to heart.'
- source_sentence: What steps should I follow to transition my puppy from walking
in a low-distraction area to more crowded places while using a Halti?
sentences:
- examine teeth and inside the mouth. This will desensitize your dog to people touching
your dog’s mouth. Make sure your dog has proper dental care. Proper dental care
is so often overlooked! Massage the sacral joint where the spine meets the tail
and lift the tail to desensitize your dog to handling. Teach your dog how to give
consent, how to ask for a break, and how to ask you to stop. Choice and consent
are the wave of the future in modern cooperative care.
- 'If your adolescent puppy is still pulling on the leash despite all the basic
leash walking training I’ve taken you through, you might choose to try a Halti
leash. I’m a big fan of Haltis, as they make a massive difference with dogs who
continue to have pulling problems, especially reactive dogs who can pull unexpectedly.
A Halti is a gentle head harness that controls the dog by the snout and takes
all the pressure off the throat.
To introduce a Halti, you must first make sure your puppy is comfortable putting
their nose into the Halti. Do this by simply slipping it on and off and rewarding
your puppy heavily for this (YES, and a treat). You’ll then need to get your puppy
comfortable with having the Halti done up, so again, go heavy on the rewards and
praise. Then you need to master walking your puppy with a Halti on in a low-distraction
environment (i.e., your garden or somewhere else familiar, without loads of other
dogs and people). Once your dog is comfortable moving around your garden, you
can move to outside; get your dog comfortable in your street before moving on
to high- distraction-level areas, such as parks. A decent structured walk should
be ten minutes, with your dog nicely walking by your side, followed by five minutes
where you allow your puppy to sniff and explore a little, before returning to
a more structured HEEL walk.
TIP: Haltis can be tricky to put on at first, so watch a few online videos or ask
a friend
to demonstrate theirs just to get a feel for how they work. Waving a Halti around
and'
- 'Think of your dog’s veterinarian as being on par with your doctor or your child’s
pediatrician. Medical knowledge is essential, but a good bedside manner is the
cherry on top of the sundae. Speak with the receptionists and bring in your pup
for a cheerful social call before their initial visit. Talk to the doctor like
they’re a neighbor. Do you feel comfortable sharing all your canine concerns with
them?
If you’re unsure of which veterinarian to use, ask around. You can narrow your
search by asking your friends and family whom they use and why.
Puppies can be quite impulsive — they often swallow things that look edible before
even considering whether they are. So, at your puppy’s first veterinary visit,
ask the doctor for a recommended method for inducing vomiting. You should also
find out the poison-control hotline number and always keep it on your phone in
case of an emergency. Seek out a 24-hour emergency veterinary hospital in your
area as well. Keep the hospital’s number by or on your phone. Accidents can happen
during off hours, so have a plan.
Whether your life demands consistent hours away from home or circumstance steps
in to temporarily rearrange your schedule, knowing a dog walker can make the difference
between a happy puppy and a stressed-out one. Puppies are like human babies in
that they have a strong need dependency. Even though an adult dog can hold their
bladder until you get home or can survive until a late meal, your puppy may well
eat the walls of your house if you get stuck in traffic. A reliable dog walker
can be a godsend in times like these.'
- source_sentence: What breeds of dogs might struggle more with swimming, and how
can I support them if they are hesitant to enter the water?
sentences:
- 'Never throw your dog into the water to “see how it goes”—because your dog can
easily drown, struggle or thrash and any trust you may have established will be
broken. The safest, least stressful, and most effective way to teach a dog to
swim is to use a properly-fitted life jacket. A life jacket often helps new swimmers
relax enough to paddle with all four legs.
Desensitize your dog to wearing a dog life jacket to keep him afloat and to provide
peace of mind for you. Your dog’s innate ability to swim or ease in learning to
swim is, in part, determined by breed and body morphology. Even some retrievers
need a helping hand to learn and find the confidence to swim for fun and exercise.
Breeds with short legs and wide chests such as Bulldogs, Boston Terriers, Corgis,
and Pugs, simply were not bred for swimming. Large, muscled breeds such as the
bully breeds, require a great deal of energy expenditure in the water due to their
significant body mass. Sight hounds, such as Salukis, Whippets, Italian Greyhounds
and Greyhounds, have the disadvantage of both large muscles and little body fat
to keep them afloat.'
- 'The key to etiquette training is to set your goals and share them with family
and friends — and even with strangers who interact with your pup. Think of this
last training chapter of Part 3 as sending your puppy off to Miss Sarah’s School
of Dog Etiquette, which is a short-term course with long-term freedoms and rewards.
To develop the all-important canine consciousness, you must do two things:
» Decide what you want when you give a direction. » Follow through — if your expectations
are unclear, your puppy’s reaction will
When debuting that almost-grown puppy of yours, follow these five essential rules:
1. Make sure your puppy is familiar and comfortable with the setting before you
attempt to introduce them to anyone. Don’t greet people your first day out.
2. Before each introduction, insist that your puppy stand still at your side.
Gently hold still or bring them back to your side and instruct “Wait.”
3. Tell admirers “We’re in training.” This statement will help them respect your
efforts and contain their excitement (hopefully).
4. Stay more focused on your puppy than on the admirer. Insist that your puppy
use good manners before you let them approach a new dog or person. 5. Put faith
in your knowledge. Just because everyone has advice doesn’t mean they’re right.
“I don’t mind if they jump” doesn’t hold water. You mind if they jump, so don’t
give in.
Under and back: Helpful commands when you’re out and about
Have you ever marveled at the sight of a dog lying patiently under the table or
their human’s legs? It’s calming on all fronts because the dog is at peace knowing
that the person is safe and in charge. Fortunately for you, it couldn’t be easier
to teach your pup this skill.'
- 'exposed to an aversive stimulus that it cannot escape or avoid, and which nothing
it does has any effect on, eventually its avoidance responses will extinguish.
It will stop reacting to the stimulus, pay no attention, and apparently become
unaware of it. This is called habituation. In my New York apartment I found the
street noise unbearable at first, but eventually, like most New Yorkers, I learned
to sleep through the sirens, yelling, garbage trucks, even car crashes. I became
habituated. Police horses are sometimes trained by subjecting them to all kinds
of harmless but alarming events, such as opening umbrellas, flapping papers, being
tapped all over with rattling tin cans, and so on. The horses become so habituated
to startling sights and sounds that they remain unflappable no matter what events
the city streets have to offer.
Method 4 is not useful for getting rid of well-learned, self-rewarding behavior
patterns. It is good, however, for whining, sulking, or teasing. Even small children
can learn - and are gratified to discover - that they can stop older children from
teasing them merely by not reacting in any way, good or bad.
BEHAVIOR Roommate leaves dirty laundry all over the place. Dog in yard barks all
night.
This behavior is self-reinforcing and seldom extinguishes spontaneously. A certain
amount of noise is natural and harmless; let it be, they''ll get tired of it.
See to it that his or her harsh words have no results, either good or bad. Work
on other strokes, footwork, and so on, and try to let the specific error die down
from lack of concentrating on it. If the misbehavior is a way of getting attention,
remove the attention; shirking,'
- source_sentence: What should I do if I notice signs of an ear infection in my puppy?
sentences:
- 'Puppies love interactive games, especially as they mature. Tug is a great game
for puppies and can be used to teach your puppy to Give on command, as well as
learning what is and isn’t okay to tug on — your hair or slippers, for example.
Here’s a quick lesson on playing tug with a young puppy:
» Start with a rope or doggie play pole, which can also be fashioned out of a
» Bounce the toy in front of your puppy or wait until they show interest in
playing with it. Reward their interest by saying “Tug” and providing resistance.
» Take a smelly food treat in your hand (like liver, hot dog, or jerky-type treat)
» Let your puppy have the toy back right away and continue playing or say “You
Soon your puppy will learn that sharing and releasing toys means more fun and
interaction, not less.
When picking out self-soothing toys for your puppy (objects they can play with
alone), keep the analogy of giving a child your smartphone to keep them busy when
you’re present but not accessible. Self-soothing objects come in many forms: What
calms your puppy best?
Though you generally can’t go wrong with indestructible plastic bones, some puppies
find them, well, boring. Rawhide, which is made in America, is a satisfy- ing
chew, but it’s problematic with some dogs who chew obsessively because they gulp
it as they go and can choke or get indigestion. Destructible bones also cost money
to replace — just saying.
Personally, my clients have had the most luck with pressed rawhide, animal-part
sticks (hooves and bully sticks), and vegetable-matter pulp bones. Test out a
few kinds yourself to find a bone that satisfies your puppy’s craving and that
can pass the “systems” test (their digestive system, that is); then buy it in
bulk.'
- 'Don’t use cotton swabs or poke into your puppy’s ear canal. You can cause irreparable
damage by doing so.
» Prevent water from entering the ear. If you’re bathing your pup, put a cotton
ball in the opening ahead of time and wipe the ears out with a dry cotton ball
when you’re finished.
Ear infections are quite common. Signs of infection include a red or swollen ear,
discharge, head shaking, ear itching, or bad odor. If you notice any of these
symp- toms, get your puppy to their doctor immediately. Left untreated, infections
can cause fever, depression, irritability, and loss of balance. Your veterinarian
may prescribe an ointment that you administer at home. Here’s how to use it:
1. Wait until your dog’s a little sleepy. 2. Bring them to the refrigerator and
swipe some peanut butter or broth at their eye level.
3. As they’re licking the refrigerator, gently squeeze into their ear canal the
amount of ointment specified by your veterinarian.
You don’t have to know much about the nose, though it is helpful for tipping you
off to the fact that your puppy’s not feeling well. A warm nose can be caused
by elevated temperature. (See the nearby sidebar, “Taking your puppy’s tempera-
ture.”) However, weather conditions also can lead to dryness or fluctuation in
body temperature. If you suspect that your puppy has a fever, touch their other
body areas without fur (belly, paws, or the inside of their ears) or take their
tem- perature. Did I mention that you have to do it rectally? What fun!'
- 'More than 320 breeds are now registered worldwide. These days, being a purebred
dog is like belonging to an exclusive club: Only dogs with similar looks and inter-
ests get in. Although most breeds are no longer asked to do the work they were
developed for, fanciers continually devote themselves to breeding and selling
puppies that reflect their traditions.
Choosing a specific breed enables you to predict the size, weight, and interest
of your puppy. Selecting a one-of-a-kind mixed-breed puppy, and predicting or
discovering the various breeds that combine to create them, allows you to make
accurate descriptions about their interests and energy level as an adult dog.
When researching a breed, mixed-breed, or designer-mixed-breed, try to meet at
least three adult dogs of the same breed or mix-breeds. All puppies are cute and
adorable, but they grow up in the blink of an eye, so make sure you like the look
and personality of the dog your puppy will become.
Whether you’re considering a purebred, mixed-breed, or designer-mixed-breed, take
a good, hard look at your lifestyle now and project out five to ten years. How
might a certain breed’s or mixed breed’s interests and energy level play out in
your home?'
pipeline_tag: sentence-similarity
library_name: sentence-transformers
metrics:
- cosine_accuracy@1
- cosine_accuracy@3
- cosine_accuracy@5
- cosine_accuracy@10
- cosine_precision@1
- cosine_precision@3
- cosine_precision@5
- cosine_precision@10
- cosine_recall@1
- cosine_recall@3
- cosine_recall@5
- cosine_recall@10
- cosine_ndcg@10
- cosine_mrr@10
- cosine_map@100
model-index:
- name: SentenceTransformer based on Snowflake/snowflake-arctic-embed-l
results:
- task:
type: information-retrieval
name: Information Retrieval
dataset:
name: Unknown
type: unknown
metrics:
- type: cosine_accuracy@1
value: 0.6666666666666666
name: Cosine Accuracy@1
- type: cosine_accuracy@3
value: 0.8533333333333334
name: Cosine Accuracy@3
- type: cosine_accuracy@5
value: 0.9266666666666666
name: Cosine Accuracy@5
- type: cosine_accuracy@10
value: 0.96
name: Cosine Accuracy@10
- type: cosine_precision@1
value: 0.6666666666666666
name: Cosine Precision@1
- type: cosine_precision@3
value: 0.2844444444444444
name: Cosine Precision@3
- type: cosine_precision@5
value: 0.1853333333333333
name: Cosine Precision@5
- type: cosine_precision@10
value: 0.09599999999999996
name: Cosine Precision@10
- type: cosine_recall@1
value: 0.6666666666666666
name: Cosine Recall@1
- type: cosine_recall@3
value: 0.8533333333333334
name: Cosine Recall@3
- type: cosine_recall@5
value: 0.9266666666666666
name: Cosine Recall@5
- type: cosine_recall@10
value: 0.96
name: Cosine Recall@10
- type: cosine_ndcg@10
value: 0.8201527661146794
name: Cosine Ndcg@10
- type: cosine_mrr@10
value: 0.7745740740740741
name: Cosine Mrr@10
- type: cosine_map@100
value: 0.7766199861997735
name: Cosine Map@100
---
# SentenceTransformer based on Snowflake/snowflake-arctic-embed-l
This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [Snowflake/snowflake-arctic-embed-l](https://huggingface.co/Snowflake/snowflake-arctic-embed-l). It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
## Model Details
### Model Description
- **Model Type:** Sentence Transformer
- **Base model:** [Snowflake/snowflake-arctic-embed-l](https://huggingface.co/Snowflake/snowflake-arctic-embed-l) <!-- at revision d8fb21ca8d905d2832ee8b96c894d3298964346b -->
- **Maximum Sequence Length:** 512 tokens
- **Output Dimensionality:** 1024 dimensions
- **Similarity Function:** Cosine Similarity
<!-- - **Training Dataset:** Unknown -->
<!-- - **Language:** Unknown -->
<!-- - **License:** Unknown -->
### Model Sources
- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
### Full Model Architecture
```
SentenceTransformer(
(0): Transformer({'max_seq_length': 512, 'do_lower_case': False}) with Transformer model: BertModel
(1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
(2): Normalize()
)
```
## Usage
### Direct Usage (Sentence Transformers)
First install the Sentence Transformers library:
```bash
pip install -U sentence-transformers
```
Then you can load this model and run inference.
```python
from sentence_transformers import SentenceTransformer
# Download from the 🤗 Hub
model = SentenceTransformer("JTh34/puppy-embed-colab-d23f57a4")
# Run inference
sentences = [
'What should I do if I notice signs of an ear infection in my puppy?',
'Don’t use cotton swabs or poke into your puppy’s ear canal. You can cause irreparable damage by doing so.\n\n» Prevent water from entering the ear. If you’re bathing your pup, put a cotton ball in the opening ahead of time and wipe the ears out with a dry cotton ball when you’re finished.\n\nEar infections are quite common. Signs of infection include a red or swollen ear, discharge, head shaking, ear itching, or bad odor. If you notice any of these symp- toms, get your puppy to their doctor immediately. Left untreated, infections can cause fever, depression, irritability, and loss of balance. Your veterinarian may prescribe an ointment that you administer at home. Here’s how to use it:\n\n1. Wait until your dog’s a little sleepy. 2. Bring them to the refrigerator and swipe some peanut butter or broth at their eye level.\n\n3. As they’re licking the refrigerator, gently squeeze into their ear canal the amount of ointment specified by your veterinarian.\n\nYou don’t have to know much about the nose, though it is helpful for tipping you off to the fact that your puppy’s not feeling well. A warm nose can be caused by elevated temperature. (See the nearby sidebar, “Taking your puppy’s tempera- ture.”) However, weather conditions also can lead to dryness or fluctuation in body temperature. If you suspect that your puppy has a fever, touch their other body areas without fur (belly, paws, or the inside of their ears) or take their tem- perature. Did I mention that you have to do it rectally? What fun!',
'More than 320 breeds are now registered worldwide. These days, being a purebred dog is like belonging to an exclusive club: Only dogs with similar looks and inter- ests get in. Although most breeds are no longer asked to do the work they were developed for, fanciers continually devote themselves to breeding and selling puppies that reflect their traditions.\n\nChoosing a specific breed enables you to predict the size, weight, and interest of your puppy. Selecting a one-of-a-kind mixed-breed puppy, and predicting or discovering the various breeds that combine to create them, allows you to make accurate descriptions about their interests and energy level as an adult dog.\n\nWhen researching a breed, mixed-breed, or designer-mixed-breed, try to meet at least three adult dogs of the same breed or mix-breeds. All puppies are cute and adorable, but they grow up in the blink of an eye, so make sure you like the look and personality of the dog your puppy will become.\n\nWhether you’re considering a purebred, mixed-breed, or designer-mixed-breed, take a good, hard look at your lifestyle now and project out five to ten years. How might a certain breed’s or mixed breed’s interests and energy level play out in your home?',
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]
# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]
```
<!--
### Direct Usage (Transformers)
<details><summary>Click to see the direct usage in Transformers</summary>
</details>
-->
<!--
### Downstream Usage (Sentence Transformers)
You can finetune this model on your own dataset.
<details><summary>Click to expand</summary>
</details>
-->
<!--
### Out-of-Scope Use
*List how the model may foreseeably be misused and address what users ought not to do with the model.*
-->
## Evaluation
### Metrics
#### Information Retrieval
* Evaluated with [<code>InformationRetrievalEvaluator</code>](https://sbert.net/docs/package_reference/sentence_transformer/evaluation.html#sentence_transformers.evaluation.InformationRetrievalEvaluator)
| Metric | Value |
|:--------------------|:-----------|
| cosine_accuracy@1 | 0.6667 |
| cosine_accuracy@3 | 0.8533 |
| cosine_accuracy@5 | 0.9267 |
| cosine_accuracy@10 | 0.96 |
| cosine_precision@1 | 0.6667 |
| cosine_precision@3 | 0.2844 |
| cosine_precision@5 | 0.1853 |
| cosine_precision@10 | 0.096 |
| cosine_recall@1 | 0.6667 |
| cosine_recall@3 | 0.8533 |
| cosine_recall@5 | 0.9267 |
| cosine_recall@10 | 0.96 |
| **cosine_ndcg@10** | **0.8202** |
| cosine_mrr@10 | 0.7746 |
| cosine_map@100 | 0.7766 |
<!--
## Bias, Risks and Limitations
*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
-->
<!--
### Recommendations
*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
-->
## Training Details
### Training Dataset
#### Unnamed Dataset
* Size: 700 training samples
* Columns: <code>sentence_0</code> and <code>sentence_1</code>
* Approximate statistics based on the first 700 samples:
| | sentence_0 | sentence_1 |
|:--------|:-----------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
| type | string | string |
| details | <ul><li>min: 15 tokens</li><li>mean: 23.47 tokens</li><li>max: 40 tokens</li></ul> | <ul><li>min: 44 tokens</li><li>mean: 331.62 tokens</li><li>max: 512 tokens</li></ul> |
* Samples:
| sentence_0 | sentence_1 |
|:--------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| <code>What techniques can I apply to train my puppy to stay calm and still when I approach, similar to how llamas are trained?</code> | <code>are each a process, defined by results. Negative reinforcers can be used effectively to train behavior, and even though aversive stimuli are involved, the process can be relatively benign. Here (with thanks to llama expert Jim Logan) is a nice use of the negative reinforcer with a semidomestic animal, the llama, kept in the United States as pets and elsewhere as pack animals and for their wool.<br><br>Llamas are timid and shy, like horses. Unless handled a lot when young,<br><br>they can be hard to approach. So, while operant conditioning with a food reinforcer works splendidly with llamas, if a llama is too skittish to come close enough to a person to take the food, here's what modern llama trainers do. They use a clicker as a signal to tell the llama that what it is doing has earned a reinforcer, but the primary or real reinforcer is the removal of a negative reinforcer, an aversive.<br><br>In effect, you say to the llama, "Will you stand still if I approach within<br><br>thirty feet? Yes? Good. I'll click m...</code> |
| <code>What are the best ways to socialize my hound puppy with household pets to avoid any chasing instincts?</code> | <code>When these puppies are exercised, directed, and included, no group is more happy-go-lucky and accepting of life’s random chaos. But when they don’t get enough playtime or training, they can be hyperactive and destructive.<br><br>Even though the loyal and cheerful dogs in the Sporting group have well-earned reputations as patient family pets, they need both mental and physical stimulation. They can’t cope with long hours of isolation; coupled with a lack of exercise, this isolation fuels anxiety. An unhappy Sporting dog is destructive, hyperactive, and impulsive. This isn’t a good mix — especially for your couch and end table.<br><br>The dogs in the Hound group are a happy lot with a 1-track mind; their fascination with hunting propels them through life and allows them plenty of opportunity for employment. Though you may have no interest in hunting a fox, chasing deer, or treeing a raccoon, your hound puppy probably will.<br><br>Originally teamed in pairs or packs, each hound was prized for their instinc...</code> |
| <code>What are the top five dog breeds recommended for first-time owners, and what makes them suitable for beginners?</code> | <code>Now don’t get me wrong, I’m not trying to put you off. I love dogs, and I think everyone can benefit from having one in their life. If you’re still unsure which breed is right for you, let me suggest a few that I think make brilliant first dogs.<br><br>Every trainer and dog lover will tell you something different about what breeds are best for you. At the end of the day, it’s your choice. But these are my top five dogs for a first-time owner. I’ve chosen them based on a decade’s experience of working with breeds of all sorts and seeing firsthand some of the common problems among dogs. These five are all typically easygoing, good-natured, smart, and willing to learn. The Rottweiler man in me can observe occasional “over-friendliness” in these breeds, but that’s not a bad thing for beginners, and basically makes them perfect for the novice trainer. If your heart is set on an American bully, but you’ve never had a dog before, think about having one of these dogs first—you can always grow your family l...</code> |
* Loss: [<code>MatryoshkaLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#matryoshkaloss) with these parameters:
```json
{
"loss": "MultipleNegativesRankingLoss",
"matryoshka_dims": [
1024,
512,
256,
128,
64
],
"matryoshka_weights": [
1,
1,
1,
1,
1
],
"n_dims_per_step": -1
}
```
### Training Hyperparameters
#### Non-Default Hyperparameters
- `eval_strategy`: steps
- `per_device_train_batch_size`: 16
- `per_device_eval_batch_size`: 16
- `num_train_epochs`: 5
- `multi_dataset_batch_sampler`: round_robin
#### All Hyperparameters
<details><summary>Click to expand</summary>
- `overwrite_output_dir`: False
- `do_predict`: False
- `eval_strategy`: steps
- `prediction_loss_only`: True
- `per_device_train_batch_size`: 16
- `per_device_eval_batch_size`: 16
- `per_gpu_train_batch_size`: None
- `per_gpu_eval_batch_size`: None
- `gradient_accumulation_steps`: 1
- `eval_accumulation_steps`: None
- `torch_empty_cache_steps`: None
- `learning_rate`: 5e-05
- `weight_decay`: 0.0
- `adam_beta1`: 0.9
- `adam_beta2`: 0.999
- `adam_epsilon`: 1e-08
- `max_grad_norm`: 1
- `num_train_epochs`: 5
- `max_steps`: -1
- `lr_scheduler_type`: linear
- `lr_scheduler_kwargs`: {}
- `warmup_ratio`: 0.0
- `warmup_steps`: 0
- `log_level`: passive
- `log_level_replica`: warning
- `log_on_each_node`: True
- `logging_nan_inf_filter`: True
- `save_safetensors`: True
- `save_on_each_node`: False
- `save_only_model`: False
- `restore_callback_states_from_checkpoint`: False
- `no_cuda`: False
- `use_cpu`: False
- `use_mps_device`: False
- `seed`: 42
- `data_seed`: None
- `jit_mode_eval`: False
- `use_ipex`: False
- `bf16`: False
- `fp16`: False
- `fp16_opt_level`: O1
- `half_precision_backend`: auto
- `bf16_full_eval`: False
- `fp16_full_eval`: False
- `tf32`: None
- `local_rank`: 0
- `ddp_backend`: None
- `tpu_num_cores`: None
- `tpu_metrics_debug`: False
- `debug`: []
- `dataloader_drop_last`: False
- `dataloader_num_workers`: 0
- `dataloader_prefetch_factor`: None
- `past_index`: -1
- `disable_tqdm`: False
- `remove_unused_columns`: True
- `label_names`: None
- `load_best_model_at_end`: False
- `ignore_data_skip`: False
- `fsdp`: []
- `fsdp_min_num_params`: 0
- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
- `fsdp_transformer_layer_cls_to_wrap`: None
- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
- `deepspeed`: None
- `label_smoothing_factor`: 0.0
- `optim`: adamw_torch
- `optim_args`: None
- `adafactor`: False
- `group_by_length`: False
- `length_column_name`: length
- `ddp_find_unused_parameters`: None
- `ddp_bucket_cap_mb`: None
- `ddp_broadcast_buffers`: False
- `dataloader_pin_memory`: True
- `dataloader_persistent_workers`: False
- `skip_memory_metrics`: True
- `use_legacy_prediction_loop`: False
- `push_to_hub`: False
- `resume_from_checkpoint`: None
- `hub_model_id`: None
- `hub_strategy`: every_save
- `hub_private_repo`: None
- `hub_always_push`: False
- `gradient_checkpointing`: False
- `gradient_checkpointing_kwargs`: None
- `include_inputs_for_metrics`: False
- `include_for_metrics`: []
- `eval_do_concat_batches`: True
- `fp16_backend`: auto
- `push_to_hub_model_id`: None
- `push_to_hub_organization`: None
- `mp_parameters`:
- `auto_find_batch_size`: False
- `full_determinism`: False
- `torchdynamo`: None
- `ray_scope`: last
- `ddp_timeout`: 1800
- `torch_compile`: False
- `torch_compile_backend`: None
- `torch_compile_mode`: None
- `include_tokens_per_second`: False
- `include_num_input_tokens_seen`: False
- `neftune_noise_alpha`: None
- `optim_target_modules`: None
- `batch_eval_metrics`: False
- `eval_on_start`: False
- `use_liger_kernel`: False
- `eval_use_gather_object`: False
- `average_tokens_across_devices`: False
- `prompts`: None
- `batch_sampler`: batch_sampler
- `multi_dataset_batch_sampler`: round_robin
</details>
### Training Logs
| Epoch | Step | cosine_ndcg@10 |
|:------:|:----:|:--------------:|
| 0.5682 | 25 | 0.7986 |
| 1.0 | 44 | 0.8182 |
| 1.1364 | 50 | 0.8224 |
| 1.7045 | 75 | 0.8181 |
| 2.0 | 88 | 0.8224 |
| 2.2727 | 100 | 0.8205 |
| 2.8409 | 125 | 0.8221 |
| 3.0 | 132 | 0.8235 |
| 3.4091 | 150 | 0.8205 |
| 3.9773 | 175 | 0.8178 |
| 4.0 | 176 | 0.8184 |
| 4.5455 | 200 | 0.8204 |
| 5.0 | 220 | 0.8202 |
### Framework Versions
- Python: 3.11.12
- Sentence Transformers: 4.1.0
- Transformers: 4.52.2
- PyTorch: 2.6.0+cu124
- Accelerate: 1.7.0
- Datasets: 2.14.4
- Tokenizers: 0.21.1
## Citation
### BibTeX
#### Sentence Transformers
```bibtex
@inproceedings{reimers-2019-sentence-bert,
title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
author = "Reimers, Nils and Gurevych, Iryna",
booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
month = "11",
year = "2019",
publisher = "Association for Computational Linguistics",
url = "https://arxiv.org/abs/1908.10084",
}
```
#### MatryoshkaLoss
```bibtex
@misc{kusupati2024matryoshka,
title={Matryoshka Representation Learning},
author={Aditya Kusupati and Gantavya Bhatt and Aniket Rege and Matthew Wallingford and Aditya Sinha and Vivek Ramanujan and William Howard-Snyder and Kaifeng Chen and Sham Kakade and Prateek Jain and Ali Farhadi},
year={2024},
eprint={2205.13147},
archivePrefix={arXiv},
primaryClass={cs.LG}
}
```
#### MultipleNegativesRankingLoss
```bibtex
@misc{henderson2017efficient,
title={Efficient Natural Language Response Suggestion for Smart Reply},
author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
year={2017},
eprint={1705.00652},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
```
<!--
## Glossary
*Clearly define terms in order to be accessible across audiences.*
-->
<!--
## Model Card Authors
*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
-->
<!--
## Model Card Contact
*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
-->