Hanging During Extractions

Hello!

I'm wondering if anyone has experienced Tessitura becoming non responsive or hanging when doing a large extractions.  For example, each time I attempt to do a large extraction of about 27,000 e-mails, the system will either hang and take 30+ minutes to finally resolve or become completely unresponsive.  We have a suspicion that it may be lack of local bandwith and we are part of a consortium but the main licensee has no trouble completing the same extraction.

Would love to know anyone's experience and how you solved it.

Many thanks!

 

  • I think we can rule out bandwidth: if I understand Extractions right they're just one-off SQL Server Agent jobs, so they run on the server itself asynchronously to your communication to the server.  Now, if someone has configured the SQL Server to provide less CPU priority to your tasks, that might be the case.

  • We had this issue a while back and with some investigation from support it looked like the issue was the file writing back to the Extraction folder on the T Drive across the network.

    We've been on Tessitura since 2004 and we hadn't deleted any files from the Extraction folder. We deleted the really old ones that we would never need. Nobody ever looks at those files after we've sent the mailings anyway so we were able to delete a huge swathe of them.

    We also took the opportunity to delete really old Extractions from the Extraction Manager itself. Again we had old Extractions going back to 2004 that we didn't need. We now only keep two years worth in there, and any old ones we know were complicated and will want to copy.

    Caryl

  • The other thing to check would be whether you have any custom listbuilder elements in the extractions being run. We were having hangs on the "generate counts" step in some extractions; turned out we needed to make an edit to a custom element and that helped move things along.

    Beth





    Elizabeth Varro
    Director of Membership
    (651) 265-9829

    National Parks Adventure, now showing at the Science Museum’s William L. McKnight-3M Omnitheater, is a stunning giant screen tour of more than 25 of our nation’s most celebrated parks. Experience Yellowstone, Yosemite, the Everglades, the Grand Canyon, and more as you’ve never experienced them before - on the only screen big enough to reveal their beauty and majesty. Variety magazine wrote that the film, narrated by Robert Redford, is a “stirring celebration of the United States’ true treasures.”



    From: "Caryl Jones" <bounce-caryljones3976@tessituranetwork.com>
    To: evarro@smm.org
    Sent: Friday, April 8, 2016 2:41:10 AM
    Subject: Re: [Tessitura Technical Forum] Hanging During Extractions

    We had this issue a while back and with some investigation from support it looked like the issue was the file writing back to the Extraction folder on the T Drive across the network.

    We've been on Tessitura since 2004 and we hadn't deleted any files from the Extraction folder. We deleted the really old ones that we would never need. Nobody ever looks at those files after we've sent the mailings anyway so we were able to delete a huge swathe of them.

    We also took the opportunity to delete really old Extractions from the Extraction Manager itself. Again we had old Extractions going back to 2004 that we didn't need. We now only keep two years worth in there, and any old ones we know were complicated and will want to copy.

    Caryl

    From: Michelle Wiesel <bounce-michellewiesel7133@tessituranetwork.com>
    Sent: 4/8/2016 12:17:09 AM

    Hello!

    I'm wondering if anyone has experienced Tessitura becoming non responsive or hanging when doing a large extractions.  For example, each time I attempt to do a large extraction of about 27,000 e-mails, the system will either hang and take 30+ minutes to finally resolve or become completely unresponsive.  We have a suspicion that it may be lack of local bandwith and we are part of a consortium but the main licensee has no trouble completing the same extraction.

    Would love to know anyone's experience and how you solved it.

    Many thanks!

     




    This message was sent automatically to you by www.tessituranetwork.com because you subscribed to the Tessitura Technical Forum. You may reply to this message to post to the Technical forum or visit the site to search, read and post to the forums. In the interest of keeping the forum posts from becoming cluttered, we encourage you to delete previous message text from your reply before sending. Thank you!
  • We have also created some custom elements that can slow things down a lot.

    --Tom Brown
    Business Analytics mgr

    Brooklyn Academy of Music BAM
    Peter J. Sharp Building
    30 Lafayette Ave
    Brooklyn, NY 11217

    www.BAM.org

    Tbrown@bam.org
    718-724-8135



    On Fri, Apr 8, 2016 at 10:09 AM, Beth Varro wrote:
    The other thing to check would be whether you have any custom listbuilder elements in the extractions being run. We were having hangs on the "generate counts" step in some extractions; turned out we needed to make an edit to a custom element and that helped move things along.

    Beth


    ________________________________

    [http://www.smm.org/signatures/smm.png]

    Elizabeth Varro
    Director of Membership
    evarro@smm.org
    (651) 265-9829


    National Parks Adventure, now showing at the Science Museum’s William L. McKnight-3M Omnitheater, is a stunning giant screen tour of more than 25 of our nation’s most celebrated parks. Experience Yellowstone, Yosemite, the Everglades, the Grand Canyon, and more as you’ve never experienced them before - on the only screen big enough to reveal their beauty and majesty. Variety magazine wrote that the film, narrated by Robert Redford, is a “stirring celebration of the United States’ true treasures.”
    [http://www.smm.org/signatures/parks.jpg]

    ________________________________
    From: "Caryl Jones"
    To: evarro@smm.org
    Sent: Friday, April 8, 2016 2:41:10 AM
    Subject: Re: [Tessitura Technical Forum] Hanging During Extractions

    We had this issue a while back and with some investigation from support it looked like the issue was the file writing back to the Extraction folder on the T Drive across the network.

    We've been on Tessitura since 2004 and we hadn't deleted any files from the Extraction folder. We deleted the really old ones that we would never need. Nobody ever looks at those files after we've sent the mailings anyway so we were able to delete a huge swathe of them.

    We also took the opportunity to delete really old Extractions from the Extraction Manager itself. Again we had old Extractions going back to 2004 that we didn't need. We now only keep two years worth in there, and any old ones we know were complicated and will want to copy.

    Caryl
    From: Michelle Wiesel
    Sent: 4/8/2016 12:17:09 AM

    Hello!

    I'm wondering if anyone has experienced Tessitura becoming non responsive or hanging when doing a large extractions. For example, each time I attempt to do a large extraction of about 27,000 e-mails, the system will either hang and take 30+ minutes to finally resolve or become completely unresponsive. We have a suspicion that it may be lack of local bandwith and we are part of a consortium but the main licensee has no trouble completing the same extraction.

    Would love to know anyone's experience and how you solved it.

    Many thanks!





    This message was sent automatically to you by www.tessituranetwork.com because you subscribed to the Tessitura Technical Forum. You may reply to this message to post to the Technical forum or visit the site to search, read and post to the forums. In the interest of keeping the forum posts from becoming cluttered, we encourage you to delete previous message text from your reply before sending. Thank you!
    ________________________________

    Spam
    Not spam
    Forget previous vote




    This message was sent automatically to you by www.tessituranetwork.com because you subscribed to the Tessitura Technical Forum. You may reply to this message to post to the Technical forum or visit the site to search, read and post to the forums. In the interest of keeping the forum posts from becoming cluttered, we encourage you to delete previous message text from your reply before sending. Thank you!
  • Hi Caryl,

    Did the cleanup of old extractions provide a significant improvement? I'm the system admin for the consortium that Michelle (original poster) belongs to, and she and I have been struggling with trying to resolve her hanging extractions for months now. I'd be thrilled if this resolved it!

     

    Stacey Voigt
    Consortium Services Manager
    Santa Barbara Center for the Performing Arts
    svoigt@granadasb.org



    [edited by: Stacey Voigt at 2:18 PM (GMT -6) on 11 Apr 2016]
  • Re: custom elements --

    Is it all custom elements, or elements that touch on particular tables, or are structured in certain ways?

    This would be good to know not only for helping Michelle troubleshoot, but also for our general consortium knowledgebase.

     

    Thanks again everyone!

  • Ours was an element related to pulling the most recent membership level on an account. We rebuilt it in some way to relieve the problem. Unfortunately I'm not in IT, so I don't know the details of the issue or whether this would impact other tables, etc.

    Beth





    Elizabeth Varro
    Director of Membership
    (651) 265-9829

    National Parks Adventure, now showing at the Science Museum’s William L. McKnight-3M Omnitheater, is a stunning giant screen tour of more than 25 of our nation’s most celebrated parks. Experience Yellowstone, Yosemite, the Everglades, the Grand Canyon, and more as you’ve never experienced them before - on the only screen big enough to reveal their beauty and majesty. Variety magazine wrote that the film, narrated by Robert Redford, is a “stirring celebration of the United States’ true treasures.”



    From: "Stacey Voigt" <bounce-staceyvoigt1752@tessituranetwork.com>
    To: evarro@smm.org
    Sent: Monday, April 11, 2016 1:26:22 PM
    Subject: Re: [Tessitura Technical Forum] Hanging During Extractions

    Re: custom elements --

    Is it all custom elements, or elements that touch on particular tables, or are structured in certain ways?

    This would be good to know not only for helping Michelle troubleshoot, but also for our general consortium knowledgebase.

     

    Thanks again everyone!

    From: Tom Brown <bounce-tombrown3568@tessituranetwork.com>
    Sent: 4/8/2016 2:36:02 PM

    We have also created some custom elements that can slow things down a lot.

    --Tom Brown
    Business Analytics mgr

    Brooklyn Academy of Music BAM
    Peter J. Sharp Building
    30 Lafayette Ave
    Brooklyn, NY 11217

    www.BAM.org

    Tbrown@bam.org
    718-724-8135



    On Fri, Apr 8, 2016 at 10:09 AM, Beth Varro wrote:
    The other thing to check would be whether you have any custom listbuilder elements in the extractions being run. We were having hangs on the "generate counts" step in some extractions; turned out we needed to make an edit to a custom element and that helped move things along.

    Beth


    ________________________________

    [http://www.smm.org/signatures/smm.png]

    Elizabeth Varro
    Director of Membership
    evarro@smm.org
    (651) 265-9829


    National Parks Adventure, now showing at the Science Museum’s William L. McKnight-3M Omnitheater, is a stunning giant screen tour of more than 25 of our nation’s most celebrated parks. Experience Yellowstone, Yosemite, the Everglades, the Grand Canyon, and more as you’ve never experienced them before - on the only screen big enough to reveal their beauty and majesty. Variety magazine wrote that the film, narrated by Robert Redford, is a “stirring celebration of the United States’ true treasures.”
    [http://www.smm.org/signatures/parks.jpg]

    ________________________________
    From: "Caryl Jones"
    To: evarro@smm.org
    Sent: Friday, April 8, 2016 2:41:10 AM
    Subject: Re: [Tessitura Technical Forum] Hanging During Extractions

    We had this issue a while back and with some investigation from support it looked like the issue was the file writing back to the Extraction folder on the T Drive across the network.

    We've been on Tessitura since 2004 and we hadn't deleted any files from the Extraction folder. We deleted the really old ones that we would never need. Nobody ever looks at those files after we've sent the mailings anyway so we were able to delete a huge swathe of them.

    We also took the opportunity to delete really old Extractions from the Extraction Manager itself. Again we had old Extractions going back to 2004 that we didn't need. We now only keep two years worth in there, and any old ones we know were complicated and will want to copy.

    Caryl
    From: Michelle Wiesel
    Sent: 4/8/2016 12:17:09 AM

    Hello!

    I'm wondering if anyone has experienced Tessitura becoming non responsive or hanging when doing a large extractions. For example, each time I attempt to do a large extraction of about 27,000 e-mails, the system will either hang and take 30+ minutes to finally resolve or become completely unresponsive. We have a suspicion that it may be lack of local bandwith and we are part of a consortium but the main licensee has no trouble completing the same extraction.

    Would love to know anyone's experience and how you solved it.

    Many thanks!





    This message was sent automatically to you by www.tessituranetwork.com because you subscribed to the Tessitura Technical Forum. You may reply to this message to post to the Technical forum or visit the site to search, read and post to the forums. In the interest of keeping the forum posts from becoming cluttered, we encourage you to delete previous message text from your reply before sending. Thank you!
    ________________________________

    Spam
    Not spam
    Forget previous vote




    This message was sent automatically to you by www.tessituranetwork.com because you subscribed to the Tessitura Technical Forum. You may reply to this message to post to the Technical forum or visit the site to search, read and post to the forums. In the interest of keeping the forum posts from becoming cluttered, we encourage you to delete previous message text from your reply before sending. Thank you!


    This message was sent automatically to you by www.tessituranetwork.com because you subscribed to the Tessitura Technical Forum. You may reply to this message to post to the Technical forum or visit the site to search, read and post to the forums. In the interest of keeping the forum posts from becoming cluttered, we encourage you to delete previous message text from your reply before sending. Thank you!
  • It did help enormously. We were having to schedule all extractions out of hours and can now run them during office hours.

    We did do a lot of work with support at the time to pin point exactly what was going on before we did this. From memory,  (it was a long time ago), they did a lot of work to look at times of writing the files across the network before we did anything.

    It might be worth opening a ticket just in case.

    Caryl