Kay LaurenceKay Laurence (Learning About Dogs) · 글
extinction(소거), counterconditioning(역조건형성) 등의 원리를 다룬 기초 연구들은 매우 통제된 환경(highly controlled contexts)에서 수행됨.compliance(순응)와 obedience(복종)를 중시함.sheepdogs(양치기견)가 세상을 이해하도록 선택(bred/selected)된 방식과 반대되는(antithetical) 경우가 많음.extinction(소거)은 이전에 강화(reinforced)된 행동을 그 보상(reinforcer)을 차단함으로써 감소시키려는 프로토콜임.extinction이 흔히 사용됨.rewards (보상)를 선택하고 제공하는 것은 우리가 sheepdogs (목양견)의 유전적 본능을 억제하려는 헛된 노력을 하고 있다는 의미가 아님.rewards (보상)가 있는 삶을 제공하고, 그들의 욕구를 적절한 outcomes (결과)로 향하도록 유도하는 것임.no-training day (훈련이 없는 날)가 단순히 햇볕 아래에서 게으르게 누워 있는 날을 의미하지는 않음.obnoxious (성가신) 행동을 보이기 시작함.learner (학습자)의 남은 생애에 맞춰 속도를 조절한, 세심하게 계획된 learning pathway (학습 경로)가 필요함.signposts (이정표)를 찾게 됨.survival instinct (생존 본능)임.preparation (준비)을 받았다는 것이 모든 상황에 대비했다는 뜻은 아님.conditions (상황)을 경험하게 함으로써, 예상치 못한 일이 발생했을 때 자신의 skills (기술)을 활용하여 문제를 해결할 수 있도록 하는 것임.teach (가르치거나) 하거나, work (작업)하거나, play (놀이)를 할 때, 나머지 spectators (관람자)들이 조용히 휴식을 취하며 지켜보도록 훈련하는 방법임.Not Today and Not for My Sheepdogs by Frances McCormack | Collie Public , Seeing with New Eyes In our desire to make lives more comfortable and fulfilling for the dogs who live among us, and for ourselves as we live alongside them, we often turn to scientific inquiry to inform our understanding of them. Here, we lean on paradigms as though they provide definitive answers that we couldn’t find through observation, enquiry, and study of our own dogs. While science indubidably improves our knowledge and understanding of the world, we must also recognise that when it comes to the dynamism and individuality of the dogs with whom we live, it will necessarily be limited in terms of what it can offer: the foundational studies on principles of extinction, counterconditioning, etc., took place in highly controlled contexts with animals who have been bred into those settings and therefore who have no experience of rewards. We may find that these principles and effects that are set out in these studies don’t transfer so easily into the real world . (Article: Science Doesn’t Have All The Answers) Further, these foundational studies took place in a culture in which a dog’s compliance and obedience was valued, with an emphasis on the behaviours produced rather than the emotions underlying them. This can skew our perception towards viewing our dogs’ learning as a matter of input-output, which further diverts our focus away from how our dogs learn as opposed to what they’re learning. And to further complicate matters, many of these protocols and procedures are antithetical to the way our sheepdogs have been selected to understand the world, and they therefore can often provoke confusion or even frustration in them. In this blog post, I’ll take a brief look at three common protocols (or sets of protocols) employed putatively to “resolve” common issues that arise for sheepdogs in a domestic environment, and explain why they may not be the optimal solution for these dogs. Extinction Extinction is a protocol that seeks to diminish a previously reinforced behaviour by withholding the reinforcer. For example, if a dog jumps up, and if that jumping up has previously been reinforced by social approval (touch, talking, etc.), then the recommendation is that withholding that social approval will cause the behaviour of jumping up to extinguish. Extinction is commonly used with sheepdogs whose attempts to control the movement of their person has appeared “endearing” when they were younger, but is now becoming a nuisance at best and dangerous at worst; in this case, the withholding o
f the reward is the frustration of a need for that dog, and would be much better managed by the careful construction of alternative and compatible rewards. Let’s think about this from the dog’s perspective: the dog has learned that a stimulus that has previously predicted a reward no longer predicts that reward. This certainly happens in nature, but when we are part of that picture—when we’ve consistently been the source of the reward—this may result in distrust of the learning process that they undertake alongside us. For sheepdogs who have been selected for cooperative work, and who are acutely responsive to human attentional cues (Kaminski and Nitzschner, 2013), who must be sensitive to patterns in the environment and observe and respond to changes, it is not beyond the realms of probability that such protocols are aversive. Extinction procedures are incredibly difficult to apply and have lots of nasty side-effects – so much so that they are often described with ample cautions for both behaviorual and emotional consequences. In fact, there are even some studies to suggest that expecting a reward and not receiving it (or wanting to escape from something aversive and not being able to) can lead to what the researchers term or at least analogise to depression, and also an inhibition of learning (cf. Huston et al., 2013). Michael Domjan even notes that “a true reversal of acquisition is rarely achieved and may not be possible. The phenomena of spontaneous recovery, renewal, reinstatement, and resurgence all attest to the fact that extinction does not erase what was learned previously.” He goes on to emphasise that extinction does not erase learning: “extinction does not erase what was originally learned and the extinguished behaviour can reappear with the passage of time (spontaneous recovery), a change in context (renewal), reexposure to the US (reinstatement), or the extinction of another response (resurgence).” Impulse Control “Impulse Control” is a popular phrase in the dog business, and often regarded as a core consideration in living with sheepdogs. In human terms, the idea of “impulse control” refers to our acquired ability to make rational choices in the face of particular stimuli. In living with dogs, though, it’s often framed as the ability for a dog to pause between the presentation of a stimulus (e.g. a reward) and their response to it, in order to make a rational choice; the argument goes that this will reduce the dog’s tendency to experience frustration when they can’t have what they want, and it will slow down their predatory responses (iro
nically, this desire for a pause never seems to be a consideration when the stimulus is a human-offered cue for a behaviour…in that case, trainers generally want their dogs to respond as fast as possible). Yet, while we accept that humans can learn to control their urges just by virtue of existing in an environment where not all desires or urges can be satisfied, we assume that dogs must be taught, and in a way that we deem appropriate. Further, the idea of impulse control in dogs assumes that we must make the decision on their behalf–they must comply with our choice in the face of that stimulus, and that they should wait for our permission to engage. Unfortunately, because the idea of impulse control in dogs is a human construct, it hits our sheepdogs particularly hard: these are dogs who we have selected to be incredibly alert to the environment, to make fast decisions in response to stimuli, and to be tenacious in their work. The idea of impulse control in our dogs is another manifestation of the focus on compliance: that dogs are irrational beings whose impulses can and should be curbed by us; that we can achieve this by showing our dogs that we control access to the objects that satisfy their basic biological needs; and that we are fundamentally at odds with them, and they with their ‘best selves’, but this can be resolved by their obedience to us. In humans, impulse control disorders are regarded as clinical psychiatric disorders stemming from altered neurochemistry (e.g. serotonin levels, the balance of serotonin and dopamine, opioids). These are not common in humans, the aetiology (cause) is still disputed, and there is currently no one known treatment modality. That we attempt to apply the term to our dogs is another example of the cultural norm is of pathologizing their difference from us, thinking of training as a remedy rather than a learning opportunity. Furthermore, the protocols for “teaching” our dogs impulse control often involve withholding things that they want, or setting them up to make an error so that we can take things away from them: these are bound to lead to disappointment and even frustration for a vast majority of dogs, and don’t go very far towards helping the dog make choices that we find favourable. In fact, what we often see is a hesitation that looks like control; this is purely the suppression of behaviour. What we are trying to help the sheepdog learn in SheepBalls®, in part, then, is predatory control: how to control themselves around the prey (ball) so that they have the best success at attaining the rewards that ena
cting their predatory behaviour can bring. Dopamine bathing – the stillness, the crouch, the dropped tail, the lowered ears, the raised paw, or whatever posture your dog adopts in stillness as they await the capture without startling the prey – is one demonstration of predatory control. Counterconditioning Counterconditioning involves the modification of a response by association with a stimulus of opposite valence: we often see this attempted where a sheepdog lunges at cars and is offered food in an attempt to transform what is perceived to be an aversive stimulus into an appetitive one. Just as the brain alters behaviour, so too does the behaviour alter the brain. What this means is that the sheepdog’s control of movement is incredibly rewarding, and as a result of that reward, the set of actions that led to it cause the brain to select that option in the future. As a result, if a sheepdog has had a history of working the wrong sheep, then the sight of that sheep in the future will stimulate the electrical activity in the brain that led to the behaviour involved in seeking to control it. But while the wrong sheep may represent a potential reward (a sheepdog may successfully control the movement of a cat or their person), it may also represent a frustrated reward. The sight of a car or a motorbike, for instance, may predict a desired reward (capture) that has frequently been unattainable. The dog may respond, then, by spinning, barking, yelping, and so on: behaviours that humans like to term signs of “frustration.” A major failing of the attempt to apply counterconditioning protocols to our dog, though, is the human perception of what is aversive: we assume that Sheepdogs lunge at cars because of a negative emotional response to them, rather than considering the dog’s predisposition to being stimulated by and attempting to control movement. We also misinterpret the valence of rewards to a dog in a particular moment in time: approach-seeking predatory behaviours shut down peristalsis (digestion of food) to prepare the body for action (Löw et al., 2008), meaning that food is unlikely to be rewarding in this context, and if that is the case, then counterconditioning cannot be achieved, since the presented stimulus is not of opposite valence to the undesirable one. Counterconditioning has also been shown to be functionally similar to extinction, in that renewal of the original response is likely; in fact any fear response that returns may, in fact, be greater after renewal (Holmes et al., 2016). Conclusions Instead of seeking to suppress through extinction,
the solution is to help our sheepdogs channel their learning through the availability and reliability of rewards, so that the activities that we wish them to select for themselves become rewarding in themselves; this is the foundational method of Learning About Dogs. Our priority should be helping these dogs to develop skills through a rich reward process, and in this facilitating their ability to choose this , not that. The desirable side-effect of this is that in setting them up for success in their learning, and in making the reward process so rich and pleasurable for them, the stream is going to be more likely to flow in the direction of this . What others regard as failures of impulse control, behaviours that need to be extinguished, or responses that require counterconditioning, then, may be a gap in learning: a lack of experience of the rewards of this and a strong history of self-rewarding with that . When it comes to our dogs’ learning and the gaps we observe, it serves us well to think in terms of “not yet,” and to build the this pathway on a strong reward process and, where appropriate, management that they are more inclined to select it over that. A selection and provision of appropriate rewards will ensure that we’re not pursuing the futile endeavour of trying to suppress the heritage of our sheepdogs, but instead offering them a life of ample and appropriate rewards and channelling their needs towards appropriate outcomes. Bibliography Azrin N.H., Hutchinson R.R., Hake D.F. (1966) “Extinction-Induced Aggression.” Journal of Experimental Animal Behavior 9.3:191-204. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1338179/ Bouton ME (2004). “Context and Behavioral Processes in Extinction.” Learning & Memory , 11.5: 485-494. https://pubmed.ncbi.nlm.nih.gov/15466298/ Domjan, Michael (2015) The Principles of Learning and Behavior. Seventh Edition . Cengage. Holmes N.M., Leung H.T., & Westbrook R.F. (2016). “Counterconditioned Fear Responses Exhibit Greater Renewal than Extinguished Fear Responses.” Learning & Memory , 23.4: 141–150. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC4793199/ Huston, J.P., et al. (2013) “Animal Models of Extinction-Induced Depression: Loss of Reward and its Consequences.” Neuroscience and Biobehavioural Reviews 37.9: 2059-2070. https://doi.org/10.1016/j.neubiorev.2013.02.016 Kaminski, J. and Nitzschner, M. (2013) “Do Dogs Get the Point? A Review of Dog-Human Communication Ability.” Learning and Motivation 44.4, 294-302. Löw, Andreas, et al. (2008) “Both Predator and Prey: Emotional Arousal in Threat and Reward.” Psycholo
gical Science 19.9: 865-873. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3612950/ A Day of Learning A no-training day does not mean he gets a lazy day lying idly in the sun. Learning is still happening and this is significant and important for his development. Read More Obnoxious Puppy The delight of your new puppy is probably going to last a few weeks, maybe four if you are lucky. When 12 weeks old hits, and you will feel a slam, the Delight is going to demonstrate ungrateful, obnoxious traits. Read More A New Puppy. Oh Joy. Impulse buying the wrong sofa can be rectified if you swallow the expense. Impulse buying a puppy can result in personal grief for you and your family and quite possibly result in a very unhappy future or end the life of that puppy. Read More It’s Not Training A carefully planned learning pathway, paced to suit that particular learner for their life ahead. Read More A Road to Nowhere When familiarity is stripped away we seek recognisable signposts that will take us back to comfort and security. This is survival instinct. It is worth listening to as it keeps us alive. Read More The Experienced Dog Knowing your dog has receive sufficient preparation does not mean every eventuality, but a range of different conditions so that when the unexpected happens they will draw on their skills and solve the issue. Read More One dog watching The other dog working or ….how to train the spectators to quietly rest and watch whilst you work, play, teach a single member of the group Read More What’s Cooking? A Warning About Recipes Recipes for “training” dogs are so prevalent in how we live with and talk about them that their existence often goes unquestioned. Read More A Cue or not a cue? With thoughtful planning and a good understanding of the relevance of antecedent selection we can teach the dog the skills of sorting the wheat from the chaff, finding the bones of the exercise. This skill is critical to being able to distinguish between distractions, which are just cues for an alternative reward opportunity, and cues which signify a guarantee of success. Read More Going Shopping This is a joint travelling adventure. It completely resets the learning and can easily extend the reinforcement process. Read More Luring: Hand lures Learning the skills for clear communication with hand-lure: collect, engage, follow, feed. Read More The Fade-in Protocol Even though today we are surrounded by many available protocols for teaching with positive reinforcement, there is still a persistence that a dog should be set-up to make an error. An error is simply the d
ifference between my expectation and the dog’s response. No more “distractions”, but faded-in environments. Read More Submit a Comment Cancel reply Your email address will not be published. Required fields are marked * Comment * Name * Email * Website Δ