Kay LaurenceKay Laurence (Learning About Dogs) · 글
Learning About Dogs의 'The Effect of Anticipation: Introducing Anticipatory Behaviour'(2018년 7월 발행)를 바탕으로 함.A B C(Antecedent-Behavior-Consequence)는 결과에 대한 anticipation(기대감)을 사용함.anticipatory build(기대감의 고조)를 더하지 않는 것은 아닌가?"three second rule" (3초 규칙)click 또는 marker(마커) 이후 3초 이내에 (보상)가 제공되어야 한다는 이론.reinforcerclick AND treat라는 용어가 정설처럼 굳어지면서, 많은 초보 훈련사들이 click 이후의 reinforcement process(보상 과정)가 아닌, 단순히 treat(간식)를 주는 행위에만 국한되어 생각하는 한계가 생김.kill(포획)에 대한 기대감.shepherd(양치기)로부터 멀리 떨어져 긴 거리를 달려 양 뒤쪽으로 위치함.stalk(스토킹) 행동으로 전환됨.anticipatory state(기대 상태)는 불필요한 정보나 반응을 배제함.fade-in 과정 시작 단계: reinforcer(보상)를 획득하기 직전 단계에 disrupting event(DE, 방해 사건)를 도입함.station on the platform(플랫폼 위에 위치하도록 지시)을 요구함.mark(표시)하고, 사이드 유닛에 대기 중인 treat box(간식통)로 동행하도록 해제(release)함.anticipation excitement(기대감에 의한 흥분)를 표현함으로써 언어적으로 개에게 기대감을 증폭시킴.predatory types of behaviours(포식적 유형의 행동)는 해당 개들이 음식 전달을 기대하며 흥분 수준을 높이는 데 기여함.anticipatory state(예기 상태)와 predatory-like(포식 행동과 유사한) 특징increased animation(증가된 활기)을 보이는 것을 통해 high anticipatory state(높은 예기 상태)에 있음을 인식할 수 있음.treat pot(간식통)에 가까워질수록 입을 닫는 모습은 predatory-like(포식 행동과 유사한) 특징을 나타냄.disrupting event(DE, 방해 요인)의 활용과 원칙anticipatory travel(예기 이동) 도중 발생하는 DE(방해 요인)는 반려견에게 아주 미세한 방해만 일으킴.DE(방해 요인)의 예시:avoidance response(회피 반응)를 보일 만한 DE(방해 요인)는 절대 사용하지 않음.training(훈련)은 동일한 행동과 anticipatory reinforcement travel(예기적 보상 이동)을 유지하며 reinforcement station(보상 지점)으로 이동하는 방식으로 진행함.DE(방해 요인)의 발생 시점 순서:anticipatory travel(예기 이동) 중cue(신호)와 behaviour(행동) 사이cue(신호) 직전behaviour(행동) 도중reinforcer(보상)가 전달된 후이자 다음 cue(신호)가 주어지기 전.behaviour(행동) 자체가 약화되기 쉬운 단계이므로, 해당 단계에서의 DE(방해 요인) 투입은 가장 마지막으로 미룸.anticipatory travel(예기 이동) 단계에서 DE(방해 요인) 사용의 핵심anticipatory state(예기 상태)는 다른 기회 요인들을 배제하고, 반려견의 집중력을 known reinforcers(알려진 보상)로 향하게 하며, predatory anticipation(포식적 예기)의 초점과 연결함.DE(방해 요인) 자체가 anticipatory travel(예기 이동)을 기대하게 만드는 cue(신호)가 될 수 있음.anticipatory travel(예기 이동) 이전의 long duration(긴 지속 시간)은 점진적이고 성공적으로 학습될 수 있음.cycle(순환)의 필수 요소cycle(순환)이 명확히 학습되고, 연습되고, anticipatory travel(예기 이동)과 함께 강화되어야 함:cue seeking(신호 찾기) > strong, stable behaviour(강하고 안정적인 행동) > anticipatory travel(예기 이동) > reinforcement process(보상 과정)cycle(순환)이 충분히 연습되지 않고 숙련되지 않으며 신뢰할 수 없을 경우, DE(방해 요인)에 대해 frustration(좌절), rage(분노), aggression(공격성)으로 반응할 가능성이 큼.anticipation(예기)이 잘못된 방향으로 흐를 때crate(켄넬) 안에서 밖으로 나가는 것을 예기하며 짖는 행동lacking impulse control(충동 조절 부족)”이라 표현하지만, 실제로는 “lacking any teaching or learning(어떠한 가르침이나 학습의 부족)”일 가능성이 크며, 원인과 결과를 우연히 연결해 버린 단일하고 긍정적인 경험의 결과임.anticipation(예기)을 방지하기 위해 broken patterns(깨진 패턴)에 노출되어야 하며, 어떤 행동이 anticipatory event(예기적 사건)를 유발하는지 학습해야 함.anticipatory behaviours(예기 행동)의 학습은 clear(명확하고), clean(군더더기 없으며), solid(탄탄해야) 함.untapped reinforcement processes(활용되지 않은 보상 과정)behaviour cycles(행동 사이클) A, B, C는 anticipation of the consequences(결과에 대한 예기)를 활용함.reinforcement process(보상 과정)가 너무 평범하며 anticipatory build(예기적 구축)가 충분하지 않은 것은 아닌지 검토해야 함.click and shove(클릭하고 밀어넣기)”라고 칭함)은 reinforcement processes(보상 과정)에서 누릴 수 있는 즐거움을 감소시키는 효과가 있을 수 있음.cycle(순환)을 방해하는 추가적인 행동을 막고, 반려견이 스스로 선택하는 상황을 피하려는 것으로 보임.Connect and Share sounds like a biscuit" (연결하고 공유한다는 말이 마치 비스킷처럼 들리네요) — (사용자들의 참여를 비스킷이라는 보상에 빗댄 비유).Comment?(의견이 있으신가요?)Comments(의견)는 Setters(세터, 프로그램 참여자)들에게만 공개됨.Community Setters(커뮤니티 세터)는 열정, 경험, 지식, 그리고 반려견을 가진 사람들임.playing/training 과정에서 드러나는 anticipation은 매우 가치 있는 현상임.anticipation 사례:back hand shunt across the floor(바닥을 가로질러 손등으로 간식을 밀어주는 동작)bowl(그릇)catch(간식 받아먹기)freeze-stalk(멈춰서서 사냥감을 노리는 듯한 자세): 간식이 전달되기 직전, 개가 자세를 잡고 잠시 멈추는 짧은 순간.anticipation의 순간을 포착하고 가르치는 것은 훈련의 '마법'을 경험하게 하는 중요한 지점임.learning about dogs의 원리를 적용하는 것에 대한 고찰.shopping 개념:table service(식탁 서비스, 받아먹는 방식)를 선호함.chasing a treat(간식 쫓아가기)는 말의 본래 행동 레퍼토리에 없음 (풀은 도망가지 않으며, 모래 묻은 사과 조각을 먹게 하고 싶지 않기 때문).shopping(쇼핑)과 연결된 anticipation을 노령마(senior horse) 훈련에 활용함.water melon bucket(수박 양동이) 사례:shopping-style food delivery로 발전함.anticipation 표현: 간식을 주겠다고 초대하면 활기차게 뛰어가며(energetic trot) nicker(말이 낮게 울음소리를 내는 것)를 함.DE를 다룰 때의 고민:SE(Startling Events, 깜짝 놀라는 사건)가 더 큰 우려 사항임.BYBSE(Break Your Bones Event, 뼈가 부러질 정도의 위험한 사건): 말에 올라탄 상태에서 말이 놀랄 경우 발생할 수 있는 사고.BYBSE로 분류됨.Fade-in protocol 시뮬레이션 제안:anticipatory travel(기대감을 가지고 이동하는 짧은 순간)과 같은 가장 강한 순간에 소리를 재생함.Fade-in protocol의 단계적 조절:DE 발생 시점을 행동 사이클 중 더 취약한(weaker) 지점으로 옮김.startling characteristic(놀라게 하는 특징, 예: 음량) 강도를 높임.DE로 설정.targeting(타겟팅) 훈련이 소음 배경 속에서 반려견이 회복(recover)하는 데 도움을 줄 수 있는지에 대한 의문 제기.behaviours(행동)와 연관된 강력한 anticipatory thread(예측적 연결 고리) 형성shopping(쇼핑 - 물건을 탐색하거나 고르는 행위)을 일반적이고, 길게 지속되며, 강력한 interactive reinforcement(상호작용적 강화) 및 rewarding experience(보상 경험)로 활용behaviours 또는 patterns(패턴)에 강력하게 conditioned(조건화)하고자 함anticipatory experience(예측적 경험)를 압도하지 않게 하는 것reinforcement(강화) 기회로만 이 프로세스를 설계했으며, fearful reaction(공포 반응)을 유발할 수 있는 사건들로 실험한 적은 없음reinforcement(강화) 기회들조차 때로는 suspicious response(의심스러운 반응)를 유발하며, 이는 fearful events(공포스러운 사건)의 시작점이 될 수 있음behaviours를 방해하지 않음self-management(자기 관리) 능력이 더욱 유연해짐solutions(해결책)을 찾아내는 경험을 쌓음으로써 문제 해결력을 길러줌video(영상 촬영) 및 melon(멜론) 필요DE(Distracting Event - 주의 분산 사건)의 강도가 매우 낮을 경우, 초기에는 fearful response(공포 반응)가 나타나지 않고 단지 귀를 살짝 실룩거리는 정도에 그칠 수 있음DE를 매우 조심스럽게 도입하면, fear(공포) 대신 curiosity(호기심)를 자극할 가능성이 있으며, 이는 competing reinforcer(경쟁적 강화물)로서의 역할을 하게 됨DE 도입의 구체적 조건:DE를 신중하게 도입하고, 그 뒤에 treats(간식)를 제공함marker(마커)와 food consumption(음식 섭취) 사이에 DE를 배치하여, reinforcement process(강화 과정) 전체가 이를 감싸도록 함sound(소리)에 대한 association(연상)을 변화시키는 데 도움을 줄 수 있으며, 점차 다른 자극들로도 확장 가능water melon(수박)을 버킷에서 꺼내기 전에, 말을 건드리지 않으면서(말이 달려드는 것을 방지하며) sound(소리)를 재생할 수 있는 기술적 해결책과 리허설이 필요constant(변하지 않는 일정한 자극)를 설정하고, 점진적으로 자신의 circuit(움직임 경로)을 그쪽으로 이동시킴CD player 또는 speakers(스피커)가 연결된 phone(전화기) 활용 제안radio shows(라디오 방송) 활용: music(음악), voice(목성), adverts(광고)가 예측 불가능하게 나오므로 학습에 유용함novel sounds(새로운 소리)를 접했을 때 첫 번째 본능이 avoidance(회피)가 아닌 curiosity(호기심)가 되는 것이 중요함If there is a Setter pic here, then this is a Setters only page The Effect of Anticipation Introducing Anticipatory Behaviour first published July 2018
k and as we travel to the reinforcement station, during the reinforcement process. The dog is asked to station on the platform, marked when successful and then released to accompany me to the treat box waiting on the side unit. During the accompanying travel I am verbally inducing an increase in anticipation by demonstrating my own anticipation excitement and for most of my dogs this will also include either a chase or catch of the treat. These are predatory types of behaviours that, for these dogs, increase the excitement level in anticipation of the food delivery. I can recognise the dog is in a high anticipatory state with the increased animation after the release to accompany me, and the predatory-like closing of the mouth as I get closer to the treat pot. During the anticipatory travel the disrupting event (DE) is noted but minimally interrupting: we may see a flick of ear or visual acknowledgement. The DE may be a person standing near-by, walking towards us, an object being placed to the floor etc. Events that would under non-training conditions be attractive to the dog. At no time do we use disrupting events that would cause an avoidance response. Training then progresses with the same behaviour and anticipatory reinforcement travel to reinforcement station and the DE is moved to occur: 2: between the cue and the behaviour 3: just before the cue 4: during the behaviour The point most likely to be disrupted during the cycle is after the reinforcer is delivered and before the cue is given, also the behaviour is vulnerable to being weakened and is so left until the last point of disruption. The key to using the DE during the strongest part of the cycle: anticipatory travel, is that the anticipatory state is likely to exclude other opportunities, focus the dog towards the know reinforcers and associate with the focus of predatory anticipation. It is the point most likely to be successful. Because this is successful and repeated several times, the DE can become a cue to anticipate the anticipatory travel and therefore strengthen focus during other parts of the cycle. Long duration before the anticipatory travel can be taught gradually and successfully. The cycle must be clearly taught, practised and reinforced with the anticipatory travel. Cue seeking > strong, stable behaviour > anticipatory travel > reinforcement process Without this cycle being well practised, experienced and reliable, frustration, rage and aggression is likely to be the response to the DE. When anticipation goes badly wrong Travelling to the park for a walk with a dog in the back o
f the car screaming, barking. Barking in a crate on anticipation of release. Biting the treat delivery hand. Pulling on lead These behaviours occur during the absence of teaching the dog what behaviour causes the consequences to occur. Often labelled as “lacking impulse control”, but more likely “lacking any teaching or learning” and a result of single, positive experience that accidentally linked the cause with a result. These behaviour will need to be exposed to brokens patterns to prevent the anticipation as well as learning what behaviour results on the anticipatory event. This learning of anticipatory behaviours will need to be clear, clean and solid. Untapped reinforcement processes All behaviour cycles A B C are using anticipation of the consequences. But are we making the reinforcement process too vanilla and not adding sufficient anticipatory build? The process of fast delivery with very minimal anticipation, (I describe this protocol as “click and shove” ) can have the effect of reducing the pleasures that can be enjoyed in the reinforcement processes. The purpose seems to be to prevent additional behaviours from interrupting the cycle, and avoid the dog making choices. Connect and Share sounds like a biscuit ....... Comment? Comments made in this section are only on view to other Setters. Community Setters are folk who have passion, experience, knowledge and dogs. When people with the same passion get together learning explodes. More than a comment? If you would like to add more than a comment, links to videos, your own article etc, please contact us direct - use the Get In Touch at the bottom of the page 5 Comments info2 on 14th March 2019 at 9:45 pm Love this! Really love to see the anticipation when playing/training my own dogs I mostly see this in the anticipation of a ‘back hand shunt across the floor’ ‘ bowl’ or ‘catch’ of a treat when training my own dogs, just that extra pause when poised just before the treat is delivered and therefore the ‘freeze-stalk’ Need to get better at teaching my pet dog owners this as this is when you really see the magic ! Reply Michaela Hempen on 9th April 2019 at 8:06 pm Disclaimer: I have no dog training experience This article made me think about how I can use this with the horses. Horse are generally enjoying table service, chasing a treat is not in our repertoire (grass doesn’t run away and we don’t want them to eat a sand-covered apple slice). Shopping -and the linked anticipation- is something I use with my senior horse. It is not that I consciously decided to use it a training approach but was borne
out of the necessity of keeping the very much appreciated water melon slices somewhere else than in my pockets. Now I use the “water melon bucket” as shopping-style food delivery and anticipation is expressed as an energetic trot towards the feeding location as I invite him in, accompanied by a nicker. Thinking about a disrupting event DE and how to use the Fade-in protocol, I thought that for my horses, I am more concerned about “startling events” SE or, more severely BYBSE, “break your bones event” in case I sit on the horse as he startles. My training area is in the middle of a forest with lots of sounds, many concerning to the horses (in their defense, I have to add that they are surrounded by lots of wildlife including very scary wild boar and wolves). So a breaking branch is often categorised as BYBSE. I can’t control these sounds, but I could simulate the sounds and fade them in, e.g. play a recording initially at a very low volume at the strongest point of the cycle, i.e. during the (short) anticipatory travel. If that becomes irrelevant, I could then either move the moment of DE to other points in the cycle that are weaker or increase the intensity of the startling characteristic (sound volume) at the strongest moment before moving. Using different sounds from the start should make the type of sound irrelevant. Some dogs often are fearful of fireworks, aren’t they? Would such an approach work to help them in such situations? Say you use the sound of fireworks at very low intensity as a DE for an easy behavior at the strongest moment and build that up carefully. In the unescapable event of madness around end-of-the-year festivities, could targeting with that background noise help them to recover? What do you think? Reply Kay Laurence on 10th April 2019 at 8:55 am As I see this I want to try to engineer two processes, teach them individually, but then combine them. Firstly, a strong anticipatory thread associated with specific behaviours, where “shopping” is the usual, drawn out, powerful interactive reinforcement / rewarding experience. I want that strongly conditioned to certain behaviours / patterns. Secondly, experience of surrounding events that are noticed (we see the dogs’ ears twitch to a sound, eye flick to a movement) but not of sufficient attraction to override the anticipatory experience the dog is expecting. I have only engineered this with other opportunities for reinforcement, not events that may trigger a fearful reaction. But even these opportunities we design that we expect to be attractive often pose a suspicious response – pos
sibly the start of fearful events. What seems to happen is that once this event is filed away of “no relevance or benefit” then it does not appear to disrupt other behaviours until it becomes significantly invasive. Then the answer is “we don’t know” until we have tried it, seen the effect ….. but I am sure if we give them these learning opportunities they become more flexible at self-management during unexpected disruptions. I regard it as a similar lay down of experiences during development, that may not match those in later life, but have set up solutions that the youngster is experienced of finding answers. We will need video of course …. and melon. Reply Michaela Hempen on 10th April 2019 at 1:20 pm At a very low intensity, such DE may not be emit a fearful response at all, just a flick of the ear initially. If the DE is introduced very carefully, it may be possible to trigger curiosity instead of fear which would bring us back to it being a competing reinforcer. Given careful introduction of the DE, and it being followed by the treats and generally surrounded by the reinforcement process as it is initially placed between the marker and the food consumption, it may help to change the association with a (sudden) sound under these conditions – and then maybe others as well. Willing to try (and video). I just need to find a technical solution for such a project and do some dress rehearsals as to be able to push some button to play a sound before fetching the water melon from the bucket without getting pushed over by a horse demanding his well-deserved slice of fruit. Reply Kay Laurence on 11th April 2019 at 5:56 am I like to set up something as a constant, in the distance, and then gradually take my circuit towards it. Could you use a CD player or phone with speakers? Radio shows where the music / voice / adverts are not predictable? It would really be a benefit if the animals first instinct to novel sounds was curiosity, not avoidance. Reply Submit a Comment Cancel reply Your email address will not be published. Required fields are marked * Comment * Name * Email * Website Submit Comment Δ